-- Logs begin at Thu 2022-08-18 13:57:56 UTC, end at Thu 2022-08-18 15:09:53 UTC. -- Aug 18 14:42:43.331784 dv-cinder-852208-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 18 14:42:43.338988 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 18 14:42:43.343603 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 14:42:43 2022] *** Aug 18 14:42:43.343603 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 14:42:43.343603 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 14:42:43.343603 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: nodename: dv-cinder-852208-7-iscsi Aug 18 14:42:43.343603 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: machine: x86_64 Aug 18 14:42:43.343603 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: clock source: unix Aug 18 14:42:43.343603 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: pcre jit disabled Aug 18 14:42:43.343603 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: detected number of CPU cores: 4 Aug 18 14:42:43.343603 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: current working directory: / Aug 18 14:42:43.343603 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: detected binary path: /usr/bin/uwsgi-core Aug 18 14:42:43.343603 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: your processes number limit is 47680 Aug 18 14:42:43.343603 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: your memory page size is 4096 bytes Aug 18 14:42:43.343603 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: detected max file descriptor number: 2048 Aug 18 14:42:43.343603 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: lock engine: pthread robust mutexes Aug 18 14:42:43.343603 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: thunder lock: enabled Aug 18 14:42:43.343603 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 18 14:42:43.343603 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 14:42:43.382144 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: Python main interpreter initialized at 0x562551be29c0 Aug 18 14:42:43.382144 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: python threads support enabled Aug 18 14:42:43.382144 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: your server socket listen backlog is limited to 100 connections Aug 18 14:42:43.382144 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: your mercy for graceful operations on workers is 90 seconds Aug 18 14:42:43.382469 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 14:42:43.382552 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: *** Operational MODE: preforking *** Aug 18 14:42:43.382815 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: *** uWSGI is running in multiple interpreter mode *** Aug 18 14:42:43.382815 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: spawned uWSGI master process (pid: 117152) Aug 18 14:42:43.383010 dv-cinder-852208-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 18 14:42:43.383606 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: spawned uWSGI worker 1 (pid: 117153, cores: 1) Aug 18 14:42:43.386801 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: spawned uWSGI worker 2 (pid: 117154, cores: 1) Aug 18 14:42:43.386801 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 14:42:44.040360 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 14:42:44.042183 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 14:42:45.118812 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 14:42:45.118812 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: from cryptography.utils import int_from_bytes Aug 18 14:42:45.119501 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 14:42:45.119501 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: from cryptography.utils import int_from_bytes Aug 18 14:42:45.122285 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 14:42:45.122285 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: from cryptography.utils import int_from_bytes Aug 18 14:42:45.122712 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 14:42:45.122712 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: from cryptography.utils import int_from_bytes Aug 18 14:42:47.587196 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 14:42:47.587848 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 14:42:47.587963 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 14:42:47.588235 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 14:42:47.588601 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 14:42:47.588687 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 14:42:47.588783 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 14:42:47.588931 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.589020 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 14:42:47.589254 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.589869 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 14:42:47.590104 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.590201 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 14:42:47.590421 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.590522 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.590747 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.590838 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.591056 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.591154 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.591372 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.591456 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.591706 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.591817 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.592031 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.592129 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.592285 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.592399 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.592595 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.592721 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.592915 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-7-iscsi {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.593052 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.593232 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.593316 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.593533 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.593627 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.593835 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.593920 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-7-iscsi {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.594146 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.594239 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.594446 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.594532 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.594762 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.594854 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.595062 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.595205 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.595439 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.595559 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.595783 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.596026 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.596604 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.596743 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.596854 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.596971 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.597076 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.597200 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.597325 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.597418 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.597543 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.597629 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.597882 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.597967 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.598201 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.598352 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.598515 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.598620 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.598818 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.598911 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.599143 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.599250 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-7-iscsi {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.599463 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.599583 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.599808 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.599908 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.600130 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.600214 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-7-iscsi {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.600512 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.600602 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.600827 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.600911 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.601132 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.601234 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.601449 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.601542 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.601769 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.601853 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.602078 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.602187 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.602403 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.602518 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.602718 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.602837 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.603035 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.603130 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.603350 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.603452 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.603650 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.603779 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.603980 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.604093 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.604286 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.604386 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.604603 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.604709 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.604904 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.605030 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.605255 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.605347 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.605507 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.605611 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.605814 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.605901 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.606130 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.606217 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.606406 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.606504 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.606721 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.606807 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.606988 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.607073 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.607234 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.607357 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.607549 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.607696 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.607889 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.607991 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.608195 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.608296 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.608503 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.608607 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.608806 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.608893 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.609114 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.609222 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.609417 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.609510 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.609721 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.609820 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.610024 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.610116 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.610327 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.610419 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.610636 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.610727 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.610945 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.611036 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.611253 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.611344 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.611554 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.611654 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.611895 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.611999 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.612229 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.612335 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.612519 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.612617 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.612823 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.612916 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.613156 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.613261 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.613471 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.613564 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.613772 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.613864 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.614123 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.614228 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.614399 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.614492 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.614701 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.614794 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.615002 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.615108 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.615305 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.615398 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.615624 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.615738 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.615957 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.616049 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.616264 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.616355 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.616511 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.616614 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.616805 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.616898 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.617106 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.617199 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.617418 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.617524 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.617719 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.617827 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.618020 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.618119 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.618320 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.618409 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.618614 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.618702 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.618916 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.619003 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.619216 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.619314 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.619518 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.619611 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.619843 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.619940 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.620144 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.620250 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.620441 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.620533 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.621254 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.621346 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.621555 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.621656 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.621853 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.621979 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.622205 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.622297 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.622519 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.622619 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.622821 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.622914 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.623121 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.623213 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.623423 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.623582 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.623767 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.623919 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.624058 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.624195 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.624340 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.624491 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.624638 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.624789 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.624969 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.625266 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.625420 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.625570 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.625708 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.625863 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.626001 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.626179 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.626330 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.626478 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.626617 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.626777 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.626923 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.627091 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.627235 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.627382 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.627532 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.627672 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.627965 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.628121 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.628518 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.628686 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.628836 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.628974 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.629113 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.629251 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.629397 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.629538 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.629676 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.629822 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.629961 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.630116 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.630264 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.630411 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.630550 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.630697 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.630837 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.630977 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.631124 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.631264 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.631402 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.631548 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.631705 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.631861 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.632017 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.632155 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.632293 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.632431 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.632570 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.632717 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.632857 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.632995 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.633146 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.633286 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.633424 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:42:47.633608 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.633765 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.633904 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.634043 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.634232 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.634394 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.634562 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.634709 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.634879 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.635027 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.635175 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.635329 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.635468 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.635619 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.635802 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.635943 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.636114 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.636303 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.636960 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.637102 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.637276 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.637423 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.637591 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.637750 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.637890 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.638121 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.638278 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.638438 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.638586 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.638734 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.638880 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.639022 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.639169 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.639311 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.639449 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.639597 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.639782 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.639928 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.640067 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.640221 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.640362 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.640509 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.640661 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.640810 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.640957 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.641096 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.641322 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.641466 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.641604 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.641756 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.641895 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.642077 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.642248 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.642389 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.642527 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.642717 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.642874 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.643026 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.643174 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.643342 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.643489 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.643659 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.643838 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.643979 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.644134 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.644274 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.644412 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.644583 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.644775 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.644928 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.645069 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.645207 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.645345 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.645484 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.645630 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.645784 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.645935 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.646092 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.646237 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.646383 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.646529 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.646677 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.646816 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.646961 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.647099 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.647267 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.647413 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.647561 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.647740 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.647886 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.648036 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.648258 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.648416 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.648563 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.648703 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.648841 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.648992 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.649143 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.649291 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.649439 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.649578 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.649718 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.649856 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.650004 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.650153 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.650300 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.650438 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.650583 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.650722 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.650861 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.651009 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.651148 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.651323 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.651470 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.651638 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.651841 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.652020 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.652168 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.652306 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.652444 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.652619 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.652792 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.652988 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.653132 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.653271 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.653410 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.653548 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.653700 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.653850 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.653989 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.654127 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.654265 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.654428 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.654585 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.654758 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.654904 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.655043 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.655189 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.655340 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.655480 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.655642 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.655855 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.655997 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.656135 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.656290 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.656430 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.656569 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.656707 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.656876 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.657024 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.657173 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.657319 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.657479 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.657634 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.657791 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.657936 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.658119 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.658296 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.658518 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.658672 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.658858 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.659014 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.659172 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.659326 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.659471 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.659616 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.659810 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.659975 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.660123 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.660269 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.660414 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.660565 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.660711 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.660877 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.661022 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.661168 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.661325 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.661471 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.661617 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.661780 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.661927 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.662072 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.662217 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.662362 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.662515 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.662661 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.662807 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.662950 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.663094 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.663240 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.663394 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.663546 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.663725 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.663878 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.664035 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.664182 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.664336 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.664482 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.664627 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.664771 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.664922 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.665068 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.665221 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.665374 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.665520 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.665675 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.665827 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.665981 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.666127 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.666272 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.666416 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.666562 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.666706 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.666706 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.666990 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.667136 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.667280 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.667436 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.667581 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.667792 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.667944 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.668090 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.668234 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.668379 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.668539 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.668764 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.668915 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.669061 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.669226 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.669372 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.669527 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.669752 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.669900 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.670046 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.670190 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.670334 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.670488 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.670641 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.670787 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.670932 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.671087 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.671240 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.671397 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.671555 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.671719 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.671872 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.672028 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.672174 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.672332 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.672478 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.672623 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.672768 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.672914 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.673059 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.673212 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.673357 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.673512 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.673664 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.673810 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.673965 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.674110 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.674255 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.674400 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.674544 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.674694 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.674849 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.674996 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.675140 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.675285 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.675440 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.675584 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.675773 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.675927 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.676080 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.676080 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.676356 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.676356 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.676650 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.676796 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.676941 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.677087 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.677231 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.677231 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.677525 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.677670 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.677814 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.677959 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.678105 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.678258 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.678404 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.678548 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.678693 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.678923 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.679083 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.679253 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.679400 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.679544 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.679712 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.679865 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.680010 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.680171 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.680330 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.680476 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.680620 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.680764 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.680908 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.681061 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.681224 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.681370 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.681515 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.681660 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.681812 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.681958 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.682108 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.682255 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.682408 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.682553 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.682706 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.682858 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.683003 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.683649 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.683819 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.683965 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.684122 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.684275 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.684422 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.684567 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.684712 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.684864 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.685020 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.685172 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.685318 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.685464 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.685464 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.685772 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.685918 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.686063 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.686208 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.686353 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.686508 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.686661 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.686813 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.686958 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.687103 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.687246 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.687398 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.687570 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.687744 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.687896 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.688111 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.688310 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.688460 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.688617 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.688763 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.688926 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.689155 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.689307 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.689462 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.689620 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.689773 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.689919 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.690064 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.690208 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.690361 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.690508 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.690654 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.690806 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.690958 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.691104 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.691257 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.691403 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.691558 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.691760 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.691923 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.692076 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.692234 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.692379 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.692524 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.692670 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.692815 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.692968 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.693114 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.693259 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.693403 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.693557 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.693557 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.693851 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.693996 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.694141 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.694285 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.694430 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.694575 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.694729 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.694876 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.695020 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.695166 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.695320 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.695320 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.695602 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.695775 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.695936 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.696158 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.696306 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.696451 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.696596 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.696750 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.696897 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.697043 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.697043 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.697337 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.697492 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.697638 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.697783 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.697929 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.698072 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.698217 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.698217 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.698524 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.698684 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.698868 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.698868 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.699181 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.699407 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.699567 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.699770 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.699923 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.700070 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.700215 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.700360 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.700517 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.700663 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.700807 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.700951 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.701105 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.701251 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.701416 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.701562 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.701707 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.701852 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.701996 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.702142 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.702296 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.702449 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.702594 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.702739 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.702883 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.703040 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.703240 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.703394 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.703540 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.703710 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.703862 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.704025 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.704184 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.704332 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.704484 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.704629 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.704775 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.704933 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.705079 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.705235 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.705381 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.705526 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.705679 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.705834 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.705988 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.706141 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.706293 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.706439 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.706594 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.706741 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.706885 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.707030 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.707185 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.707331 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.707489 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.707636 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.707840 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.707987 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.708132 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.708276 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.708435 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.708582 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.708727 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.708878 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.708878 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.709186 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.709345 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.709583 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.709737 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.709890 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.710037 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.710199 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.710352 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.710498 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.710644 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.710797 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.710944 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.711116 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.711264 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.711410 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.711563 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.711739 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.711893 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.712055 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.712202 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.712348 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.712492 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.712638 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.712792 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.712947 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.713104 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.713250 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.713395 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.713548 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.713705 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.713851 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.714004 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.714157 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.714325 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.714479 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.714638 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.714794 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.714947 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.715103 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.715256 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.715402 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.715555 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.715727 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.715883 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.716028 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.716173 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.716319 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.716480 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.716626 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.716785 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.716932 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.717093 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.717248 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.717394 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.717539 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.717684 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.717829 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.717974 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.718127 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.718283 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.718436 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.718582 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.718739 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.718895 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.718895 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.719196 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.719341 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.719486 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.719653 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.719847 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.720015 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.720162 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.720307 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.720452 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.720597 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.720755 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.720911 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.721057 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.721202 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.721346 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.721490 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.721712 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.721860 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.722014 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.722168 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.722314 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.722314 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.722598 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.722598 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.722905 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.722905 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.723182 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.723182 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.723466 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.723619 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.723796 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.723943 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.724097 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.724263 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.724410 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.724555 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.724707 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.724870 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.725016 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.725169 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.725315 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.725466 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.725612 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.725757 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.725909 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.726067 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.726219 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.726366 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.726510 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.726654 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.726810 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.726965 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.727111 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.727255 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.727401 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.727545 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.727748 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.727902 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.728058 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.728203 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.728350 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.728495 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.728658 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.728803 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.728949 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.729105 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.729251 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.729404 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.729558 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.729704 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.729849 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.730518 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.730666 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.730811 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.730811 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.731107 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.731252 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.731396 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.731542 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.731717 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.731882 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.732035 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.732181 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.732326 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.732471 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.732625 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.732772 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.732916 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.733071 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.733215 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.733360 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.733513 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.733667 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.733812 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.733957 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.734102 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.734246 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.734403 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.734558 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.734706 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.734851 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.735009 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.735155 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.735309 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.735461 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.735607 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.735810 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.735969 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.736129 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.736276 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.736421 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.736565 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.736718 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.736874 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.737029 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.737176 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.737320 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.737465 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.737609 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.737761 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.737761 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.738048 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.738201 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.738347 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.738347 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.738634 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.738797 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.738944 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.739096 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.739242 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.739387 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.739546 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.739722 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.739876 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.740022 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.740168 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.740313 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.740470 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.740615 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.740777 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.740931 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.741076 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.741221 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.741374 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.741521 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.741666 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.741811 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.741957 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.742102 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.742256 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.742403 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.742555 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.742710 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.742863 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.743018 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.743173 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.743320 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.743465 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.743609 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.743806 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.743971 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.744118 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.744271 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.744417 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.744573 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.744718 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.744909 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.745060 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.745207 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.745351 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.745497 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.745700 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.745858 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.746004 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.746150 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.746295 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.746448 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.746448 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.746837 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.746995 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.747151 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.747305 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.747453 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.747599 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.747801 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.747916 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.748007 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.748093 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.748191 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.748191 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.748346 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.748443 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.748527 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.748613 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.748694 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.748775 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.748856 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.748947 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.749029 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.749110 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.749191 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.749272 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.749352 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.749521 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.749694 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.749850 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.750008 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.750156 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.750322 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.750483 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.750630 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.750775 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.750927 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.751074 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.751228 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.751385 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.751538 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.751712 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.751866 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.752012 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.752171 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.752319 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.752465 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.752611 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.752780 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.752972 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.753142 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.753543 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.753701 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.753847 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.753992 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.754146 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.754293 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.754446 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.754594 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.754740 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.754885 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.755039 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.755186 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.755337 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.755491 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.755648 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.755841 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.756004 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.756151 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.756297 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.756442 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.756588 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.756734 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.756891 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.757038 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.757184 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.757329 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.757491 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.757647 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.757793 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.757938 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.758083 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.758228 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.758380 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.758540 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.758687 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.758866 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.759021 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.759167 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.759313 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.759544 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.759715 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.759871 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.760028 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.760174 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.760337 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.760494 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.760641 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.760788 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.760935 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.761081 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.761738 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.761738 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.762043 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.762189 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.762334 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.762481 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.762639 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.762787 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.762941 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.763088 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.763233 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.763378 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.763533 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.763724 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.763888 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.764035 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.764180 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.764337 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.764484 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.764631 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.764776 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.764929 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.765083 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.765238 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.765385 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.765537 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.765684 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.765840 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.765986 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.766141 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.766288 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.766440 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.766587 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.766733 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.766885 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.767044 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.767192 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.767337 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.767482 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.767628 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.767818 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.767968 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.768113 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.768267 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.768420 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.768574 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.768732 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.768886 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.769033 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.769178 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.769324 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.769469 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.769623 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.769780 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.769926 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.770079 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.770226 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.770372 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.770530 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.770678 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.770832 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.770980 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.771126 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.771281 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.771435 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.771592 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.771788 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.771938 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.772094 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.772255 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.772404 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.772550 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.772696 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.772841 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.772986 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.773145 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.773299 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.773446 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.773602 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.773747 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.773893 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.774052 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.774212 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.774358 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.774358 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.774645 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.774800 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.774947 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.775093 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.775239 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.775394 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.775541 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.775724 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.775895 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.776043 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.776193 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.776339 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.776494 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.776648 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.776795 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.777003 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.777152 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.777308 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.777468 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.777617 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.777762 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.777908 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.778052 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.778196 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.778353 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.778508 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.778654 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.778800 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.778945 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.779109 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.779255 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.779400 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.779546 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.779714 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.779879 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.780035 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.780182 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.780328 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.780473 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.780621 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.780788 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.780948 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.781101 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.781247 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.781393 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.781537 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.781691 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.781838 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.781984 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.782129 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.782281 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.782434 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.782589 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.782737 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.782899 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.783046 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.783192 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.783337 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.783491 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.783639 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.783811 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.784000 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.784154 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.784315 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.784462 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.784615 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.784779 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.784926 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.785073 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.785233 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.785387 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.785533 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.785679 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.785825 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.785970 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.786130 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.786288 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.786435 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.786582 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.786737 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.786892 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.787039 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.787196 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.787350 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.787578 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.787773 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.788006 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.788222 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.788415 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.788564 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.788710 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.788874 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.789030 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.789184 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.789331 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.789486 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.789633 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.789779 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.789933 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.790081 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.790227 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.790380 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.790380 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.790673 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.790841 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.790989 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.791135 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.791282 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.791440 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.791596 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.791780 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.791937 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.792086 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.792231 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.792385 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.792385 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.793184 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.793342 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.793488 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.793634 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.793780 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.793939 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.794085 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.794232 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.794378 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.794525 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.794680 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.794827 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.794973 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.795135 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.795290 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.795438 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.795593 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.795767 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.795928 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.796083 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.796237 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.796384 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.796539 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.796686 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.796838 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.796991 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.797155 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.797302 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.797463 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.797611 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.797757 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.797911 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.798058 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.798213 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.798359 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.798512 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.798670 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.798818 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.798964 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.799132 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.799288 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.799435 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.799582 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.799776 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.799940 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.800097 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.800244 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.800397 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.800550 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.800699 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.800854 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.801013 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.801180 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.801327 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.801473 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.801619 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.801775 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.801931 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.802077 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.802077 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.802361 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.802510 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.802664 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.802813 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.802965 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.803121 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.803275 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.803422 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.803577 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.803755 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.803923 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.804071 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.804217 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.804362 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.804517 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.804670 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.804817 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.804817 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.805104 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.805259 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.805406 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.805558 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.805704 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.805850 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.805997 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.806151 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.806297 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.806443 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.806589 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.806735 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.806890 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.807046 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.807046 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.807330 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.807477 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.807623 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.807840 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.807999 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.808201 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.808356 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.808504 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.808659 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.808833 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.808833 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.809114 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.809114 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.809400 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.809546 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.809702 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.809849 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.809994 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.810140 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.810287 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.810433 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.810587 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.810758 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.810909 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.811055 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.811202 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.811362 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.811509 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.811654 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.811827 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.811974 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.812120 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.812278 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.812426 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.812586 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.812733 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.812886 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.813032 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.813191 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.813348 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.813496 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.813642 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.813787 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.813942 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.814088 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.814235 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.814381 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.814539 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.814692 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.814852 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.814999 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.815144 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.815291 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.815437 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.815584 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.815784 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.815937 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.816084 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.816230 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.816394 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.816620 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.816777 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.816924 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.817071 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.817217 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.817363 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.817519 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.817666 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.817812 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.817961 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.818113 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.818271 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.818429 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.818577 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.818723 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.818869 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.819014 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.819172 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.819320 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.819466 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.819613 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.819787 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.819946 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.820102 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.820260 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.820406 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.820558 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.820705 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.820862 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.821018 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.821165 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.821316 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.821463 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.821615 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.821763 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.821918 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.822074 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.822229 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.822375 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.822375 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.822664 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.822819 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.822966 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.823120 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.823266 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.823419 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.823574 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.824262 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.824416 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.824573 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.824719 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.824867 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.825025 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.825172 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.825318 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.825464 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.825616 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.825764 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.825920 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.826067 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.826220 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.826366 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.826521 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.826676 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.826830 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.826978 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.827123 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.827269 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.827414 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.827568 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.827746 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.827900 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.828046 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.828192 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.828337 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.828506 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.828654 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.828800 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.828953 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.829101 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.829248 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.829403 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.829550 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.829698 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.829844 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.829991 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.830151 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.830315 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.830468 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.830615 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.830769 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.830924 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.831080 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.831234 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.831384 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.831530 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.831733 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.831887 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.832047 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.832196 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.832352 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.832506 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.832653 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.832809 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.832967 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.833114 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.833261 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.833407 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.833553 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.833707 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.833854 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.834000 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.834165 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.834313 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.834459 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.834615 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.834762 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.834908 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.835060 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.835206 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.835362 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.835510 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.835662 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.835837 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.835994 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.836151 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.836307 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.836456 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.836601 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.836747 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.836892 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.837038 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.837193 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.837382 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.837540 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.837688 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.837834 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.837990 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.838145 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.838293 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.838440 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.838594 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.838741 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.838900 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.839048 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.839194 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.839382 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.840051 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.840201 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.840366 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.840527 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.840673 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.840819 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.840965 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.841110 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.841276 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 14:42:47.841432 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.841432 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.841711 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.841856 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.842149 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.842469 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.842788 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.843120 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.843451 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.843790 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.844123 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.844452 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.844801 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.845125 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.845473 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.845806 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.846127 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.846448 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.846757 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:42:47.847003 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 14:42:47.993270 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO dbcounter [None req-ab56593d-b05c-44e2-bada-467e2ca54a96 None None] Registered counter for database nova_api Aug 18 14:42:47.999550 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO dbcounter [None req-9313a4db-ae85-4500-bedb-4c81ac82d2fe None None] Registered counter for database nova_api Aug 18 14:42:48.015077 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG oslo_db.sqlalchemy.engines [None req-ab56593d-b05c-44e2-bada-467e2ca54a96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:42:48.019863 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_db.sqlalchemy.engines [None req-9313a4db-ae85-4500-bedb-4c81ac82d2fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:42:48.021637 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG dbcounter [-] [117154] Writer thread running {{(pid=117154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:42:48.026378 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG dbcounter [-] [117153] Writer thread running {{(pid=117153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:42:48.078450 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.context [None req-ab56593d-b05c-44e2-bada-467e2ca54a96 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b3f44a74-f470-4dbc-81de-0c86ad3f4d2c(cell1) {{(pid=117154) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 14:42:48.082331 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ab56593d-b05c-44e2-bada-467e2ca54a96 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:42:48.082807 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ab56593d-b05c-44e2-bada-467e2ca54a96 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:42:48.082924 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.context [None req-9313a4db-ae85-4500-bedb-4c81ac82d2fe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b3f44a74-f470-4dbc-81de-0c86ad3f4d2c(cell1) {{(pid=117153) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 14:42:48.084379 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ab56593d-b05c-44e2-bada-467e2ca54a96 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:42:48.085294 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ab56593d-b05c-44e2-bada-467e2ca54a96 None None] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:42:48.085740 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ab56593d-b05c-44e2-bada-467e2ca54a96 None None] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:42:48.086754 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9313a4db-ae85-4500-bedb-4c81ac82d2fe None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:42:48.087232 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9313a4db-ae85-4500-bedb-4c81ac82d2fe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:42:48.087793 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ab56593d-b05c-44e2-bada-467e2ca54a96 None None] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:42:48.088826 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9313a4db-ae85-4500-bedb-4c81ac82d2fe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:42:48.090171 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9313a4db-ae85-4500-bedb-4c81ac82d2fe None None] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:42:48.090321 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO dbcounter [None req-ab56593d-b05c-44e2-bada-467e2ca54a96 None None] Registered counter for database nova_cell0 Aug 18 14:42:48.090621 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9313a4db-ae85-4500-bedb-4c81ac82d2fe None None] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:42:48.092698 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9313a4db-ae85-4500-bedb-4c81ac82d2fe None None] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:42:48.094791 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO dbcounter [None req-9313a4db-ae85-4500-bedb-4c81ac82d2fe None None] Registered counter for database nova_cell0 Aug 18 14:42:48.096370 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO dbcounter [None req-ab56593d-b05c-44e2-bada-467e2ca54a96 None None] Registered counter for database nova_cell1 Aug 18 14:42:48.100923 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO dbcounter [None req-9313a4db-ae85-4500-bedb-4c81ac82d2fe None None] Registered counter for database nova_cell1 Aug 18 14:42:48.103894 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG oslo_db.sqlalchemy.engines [None req-ab56593d-b05c-44e2-bada-467e2ca54a96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:42:48.108544 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG dbcounter [-] [117154] Writer thread running {{(pid=117154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:42:48.109867 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_db.sqlalchemy.engines [None req-9313a4db-ae85-4500-bedb-4c81ac82d2fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:42:48.115054 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG dbcounter [-] [117153] Writer thread running {{(pid=117153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:42:48.253784 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG oslo_db.sqlalchemy.engines [None req-ab56593d-b05c-44e2-bada-467e2ca54a96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:42:48.258937 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG dbcounter [-] [117154] Writer thread running {{(pid=117154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:42:48.261494 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_db.sqlalchemy.engines [None req-9313a4db-ae85-4500-bedb-4c81ac82d2fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:42:48.267911 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG dbcounter [-] [117153] Writer thread running {{(pid=117153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:42:48.268688 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO dbcounter [None req-ab56593d-b05c-44e2-bada-467e2ca54a96 None None] Registered counter for database nova_cell0 Aug 18 14:42:48.277416 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO dbcounter [None req-9313a4db-ae85-4500-bedb-4c81ac82d2fe None None] Registered counter for database nova_cell0 Aug 18 14:42:48.279102 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG oslo_db.sqlalchemy.engines [None req-ab56593d-b05c-44e2-bada-467e2ca54a96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:42:48.284077 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG dbcounter [-] [117154] Writer thread running {{(pid=117154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:42:48.286808 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_db.sqlalchemy.engines [None req-9313a4db-ae85-4500-bedb-4c81ac82d2fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:42:48.291566 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG dbcounter [-] [117153] Writer thread running {{(pid=117153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:42:48.623795 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: WARNING keystonemiddleware.auth_token [None req-ab56593d-b05c-44e2-bada-467e2ca54a96 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 14:42:48.627657 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: WARNING keystonemiddleware.auth_token [None req-9313a4db-ae85-4500-bedb-4c81ac82d2fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 14:42:48.631276 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: WARNING keystonemiddleware.auth_token [None req-ab56593d-b05c-44e2-bada-467e2ca54a96 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 14:42:48.635126 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: WARNING keystonemiddleware.auth_token [None req-9313a4db-ae85-4500-bedb-4c81ac82d2fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 14:42:48.974004 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: WARNING keystonemiddleware.auth_token [None req-ab56593d-b05c-44e2-bada-467e2ca54a96 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 14:42:48.976210 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: WARNING keystonemiddleware.auth_token [None req-9313a4db-ae85-4500-bedb-4c81ac82d2fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 14:42:48.980051 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: WARNING keystonemiddleware.auth_token [None req-ab56593d-b05c-44e2-bada-467e2ca54a96 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 14:42:48.982171 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: WARNING keystonemiddleware.auth_token [None req-9313a4db-ae85-4500-bedb-4c81ac82d2fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 14:42:48.985330 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562551be29c0 pid: 117154 (default app) Aug 18 14:42:48.987403 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-ab56593d-b05c-44e2-bada-467e2ca54a96 None None] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:42:48.987516 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562551be29c0 pid: 117153 (default app) Aug 18 14:42:48.988614 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-ab56593d-b05c-44e2-bada-467e2ca54a96 None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001763 Aug 18 14:42:48.989016 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Thu Aug 18 14:42:48 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:44:06.400475 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-9313a4db-ae85-4500-bedb-4c81ac82d2fe None None] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:44:06.401818 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-9313a4db-ae85-4500-bedb-4c81ac82d2fe None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002658 Aug 18 14:44:06.402307 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 931 bytes} [Thu Aug 18 14:44:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:44:06.413634 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG dbcounter [-] [117154] Writing DB stats nova_api:SELECT=3 {{(pid=117154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:44:06.414751 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG dbcounter [-] [117154] Writing DB stats nova_cell0:SELECT=3 {{(pid=117154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:44:06.416433 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG dbcounter [-] [117154] Writing DB stats nova_cell1:SELECT=3 {{(pid=117154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:44:06.417269 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG dbcounter [-] [117154] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:44:07.270048 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-887b0e97-2e08-4fd9-a3d4-784cfa8c5496 admin admin] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:44:07.302813 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-887b0e97-2e08-4fd9-a3d4-784cfa8c5496 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.894109 Aug 18 14:44:07.303568 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 2/3] 10.222.0.36 () {60 vars in 1292 bytes} [Thu Aug 18 14:44:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:44:09.634982 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-9313a4db-ae85-4500-bedb-4c81ac82d2fe None None] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:44:09.635854 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-9313a4db-ae85-4500-bedb-4c81ac82d2fe None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001946 Aug 18 14:44:09.640218 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 2/4] 10.222.0.36 () {54 vars in 931 bytes} [Thu Aug 18 14:44:09 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:44:10.092383 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-d5c74009-f3e4-4505-9558-e0d06d3d24f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "ram": 256, "id": "c1", "swap": 0, "os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:44:10.113133 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 14:44:10.113133 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: warnings.warn(msg) Aug 18 14:44:10.143597 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-d5c74009-f3e4-4505-9558-e0d06d3d24f9 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.500205 Aug 18 14:44:10.147759 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 3/5] 10.222.0.36 () {64 vars in 1283 bytes} [Thu Aug 18 14:44:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:44:10.159476 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG dbcounter [-] [117153] Writing DB stats nova_api:SELECT=3 {{(pid=117153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:44:10.160738 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG dbcounter [-] [117153] Writing DB stats nova_cell1:SELECT=3 {{(pid=117153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:44:10.162204 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG dbcounter [-] [117153] Writing DB stats nova_cell0:SELECT=3 {{(pid=117153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:44:10.163096 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG dbcounter [-] [117153] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:44:10.377771 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-cff963b9-3648-4c16-87fb-73b9a0e32ce4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:44:10.382391 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 14:44:10.382391 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: warnings.warn(msg) Aug 18 14:44:10.445578 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-cff963b9-3648-4c16-87fb-73b9a0e32ce4 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.292035 Aug 18 14:44:10.446156 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 3/6] 10.222.0.36 () {64 vars in 1336 bytes} [Thu Aug 18 14:44:10 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:44:12.794008 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-d5c74009-f3e4-4505-9558-e0d06d3d24f9 admin admin] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:44:12.795624 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-d5c74009-f3e4-4505-9558-e0d06d3d24f9 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002056 Aug 18 14:44:12.796054 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 4/7] 10.222.0.36 () {54 vars in 931 bytes} [Thu Aug 18 14:44:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:44:13.474132 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c158092f-52b6-4feb-8a7d-1a10b161d240 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "vcpus": 1, "id": "d1", "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:44:13.496766 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 14:44:13.496766 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: warnings.warn(msg) Aug 18 14:44:13.517767 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c158092f-52b6-4feb-8a7d-1a10b161d240 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.715405 Aug 18 14:44:13.519110 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 4/8] 10.222.0.36 () {64 vars in 1283 bytes} [Thu Aug 18 14:44:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:44:13.530980 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-f904d38b-b9cd-4b89-92d9-4d7ff6921143 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:44:13.534402 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 14:44:13.534402 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: warnings.warn(msg) Aug 18 14:44:13.568231 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-f904d38b-b9cd-4b89-92d9-4d7ff6921143 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040714 Aug 18 14:44:13.569632 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 5/9] 10.222.0.36 () {64 vars in 1336 bytes} [Thu Aug 18 14:44:13 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:44:15.928479 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c158092f-52b6-4feb-8a7d-1a10b161d240 admin admin] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:44:15.929561 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c158092f-52b6-4feb-8a7d-1a10b161d240 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Aug 18 14:44:15.929969 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 931 bytes} [Thu Aug 18 14:44:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:44:16.334066 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-100f6bec-f5b3-4fdd-8b52-c48ca4e1be20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 10, "os-flavor-access:is_public": true, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "name": "ds1G", "rxtx_factor": 1.0}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:44:16.353134 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-100f6bec-f5b3-4fdd-8b52-c48ca4e1be20 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.416721 Aug 18 14:44:16.353709 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 6/11] 10.222.0.36 () {64 vars in 1283 bytes} [Thu Aug 18 14:44:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:44:16.365986 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f11b8e87-ac9e-4e0a-8ac4-fa1bbb6f881e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:44:16.390215 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f11b8e87-ac9e-4e0a-8ac4-fa1bbb6f881e admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027991 Aug 18 14:44:16.390789 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 6/12] 10.222.0.36 () {64 vars in 1336 bytes} [Thu Aug 18 14:44:16 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:44:18.733972 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-100f6bec-f5b3-4fdd-8b52-c48ca4e1be20 admin admin] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:44:18.734979 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-100f6bec-f5b3-4fdd-8b52-c48ca4e1be20 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 18 14:44:18.735370 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 7/13] 10.222.0.36 () {54 vars in 931 bytes} [Thu Aug 18 14:44:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:44:19.214744 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f70cc3ac-9feb-4f58-ab96-9901f697e9cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "ram": 2048, "disk": 10, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "name": "ds2G"}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:44:19.235585 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f70cc3ac-9feb-4f58-ab96-9901f697e9cb admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.493992 Aug 18 14:44:19.236600 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 7/14] 10.222.0.36 () {64 vars in 1283 bytes} [Thu Aug 18 14:44:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:44:19.249342 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c945222a-cafa-4857-a1f1-9ac8647495c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:44:19.273865 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-c945222a-cafa-4857-a1f1-9ac8647495c4 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028276 Aug 18 14:44:19.274499 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 8/15] 10.222.0.36 () {64 vars in 1336 bytes} [Thu Aug 18 14:44:19 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:44:21.627462 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f70cc3ac-9feb-4f58-ab96-9901f697e9cb admin admin] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:44:21.628522 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f70cc3ac-9feb-4f58-ab96-9901f697e9cb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 18 14:44:21.628927 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 8/16] 10.222.0.36 () {54 vars in 931 bytes} [Thu Aug 18 14:44:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:44:22.083155 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-cc2a484e-b24f-4b2e-b7bd-7bb47da827dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "d4", "disk": 20, "name": "ds4G", "vcpus": 4, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:44:22.102984 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-cc2a484e-b24f-4b2e-b7bd-7bb47da827dd admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.467553 Aug 18 14:44:22.103536 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 9/17] 10.222.0.36 () {64 vars in 1283 bytes} [Thu Aug 18 14:44:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:44:22.115672 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-1e5b6f21-c9d1-4c37-a74a-8c3f657e9198 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:44:22.142734 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-1e5b6f21-c9d1-4c37-a74a-8c3f657e9198 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030550 Aug 18 14:44:22.143882 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 9/18] 10.222.0.36 () {64 vars in 1336 bytes} [Thu Aug 18 14:44:22 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:44:24.696870 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-cc2a484e-b24f-4b2e-b7bd-7bb47da827dd admin admin] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:44:24.697941 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-cc2a484e-b24f-4b2e-b7bd-7bb47da827dd admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002125 Aug 18 14:44:24.698375 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 10/19] 10.222.0.36 () {54 vars in 931 bytes} [Thu Aug 18 14:44:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:44:25.138494 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-57608ebd-7e79-460e-b70f-1ec0d9ce5db9 admin admin] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:44:25.162654 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-57608ebd-7e79-460e-b70f-1ec0d9ce5db9 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.458017 Aug 18 14:44:25.163344 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 10/20] 10.222.0.36 () {60 vars in 1292 bytes} [Thu Aug 18 14:44:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:44:27.621027 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-cc2a484e-b24f-4b2e-b7bd-7bb47da827dd admin admin] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:44:27.622462 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-cc2a484e-b24f-4b2e-b7bd-7bb47da827dd admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001995 Aug 18 14:44:27.622995 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 11/21] 10.222.0.36 () {54 vars in 931 bytes} [Thu Aug 18 14:44:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:44:28.068390 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-70027255-4a28-4e30-bca4-7b809bef347d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "vcpus": 1}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:44:28.092849 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-70027255-4a28-4e30-bca4-7b809bef347d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.461680 Aug 18 14:44:28.095737 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 11/22] 10.222.0.36 () {64 vars in 1283 bytes} [Thu Aug 18 14:44:27 2022] POST /compute/v2.1/flavors => generated 402 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 14:44:28.109256 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-08fb6523-f905-43d1-87b4-00110dfe0e3a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:44:28.140255 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-08fb6523-f905-43d1-87b4-00110dfe0e3a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035729 Aug 18 14:44:28.141026 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 12/23] 10.222.0.36 () {64 vars in 1333 bytes} [Thu Aug 18 14:44:28 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:44:30.505758 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-70027255-4a28-4e30-bca4-7b809bef347d admin admin] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:44:30.506926 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-70027255-4a28-4e30-bca4-7b809bef347d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001619 Aug 18 14:44:30.507341 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 12/24] 10.222.0.36 () {54 vars in 931 bytes} [Thu Aug 18 14:44:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:44:30.902865 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-eb57cb04-8f6d-4c37-8fa4-d848310433ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "name": "m1.small", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 20, "swap": 0, "ram": 2048}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:44:30.921722 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-eb57cb04-8f6d-4c37-8fa4-d848310433ec admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.408250 Aug 18 14:44:30.922269 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 13/25] 10.222.0.36 () {64 vars in 1283 bytes} [Thu Aug 18 14:44:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 14:44:30.934826 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8a94c39e-c670-4cee-9874-6c1e558ebd54 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:44:30.959652 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-8a94c39e-c670-4cee-9874-6c1e558ebd54 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028466 Aug 18 14:44:30.960237 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 13/26] 10.222.0.36 () {64 vars in 1333 bytes} [Thu Aug 18 14:44:30 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:44:33.455277 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-eb57cb04-8f6d-4c37-8fa4-d848310433ec admin admin] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:44:33.456334 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-eb57cb04-8f6d-4c37-8fa4-d848310433ec admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Aug 18 14:44:33.456735 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 14/27] 10.222.0.36 () {54 vars in 931 bytes} [Thu Aug 18 14:44:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:44:33.924210 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-be10c5d2-5003-4038-bf82-602208149055 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.medium", "rxtx_factor": 1.0, "disk": 40}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:44:33.943864 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-be10c5d2-5003-4038-bf82-602208149055 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.479839 Aug 18 14:44:33.944425 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 14/28] 10.222.0.36 () {64 vars in 1283 bytes} [Thu Aug 18 14:44:33 2022] POST /compute/v2.1/flavors => generated 406 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:44:33.958284 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-eaa894a5-939a-4536-8b9c-793127b63597 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:44:33.984314 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-eaa894a5-939a-4536-8b9c-793127b63597 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029808 Aug 18 14:44:33.984999 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 15/29] 10.222.0.36 () {64 vars in 1333 bytes} [Thu Aug 18 14:44:33 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:44:36.395630 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-be10c5d2-5003-4038-bf82-602208149055 admin admin] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:44:36.396669 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-be10c5d2-5003-4038-bf82-602208149055 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 18 14:44:36.397227 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 15/30] 10.222.0.36 () {54 vars in 931 bytes} [Thu Aug 18 14:44:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:44:36.880075 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-cf2325a4-96d7-4630-8961-fb6fc71f7e24 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "id": "4", "name": "m1.large", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "swap": 0, "rxtx_factor": 1.0}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:44:36.887241 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG dbcounter [-] [117154] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=117154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:44:36.912160 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-cf2325a4-96d7-4630-8961-fb6fc71f7e24 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.508919 Aug 18 14:44:36.912977 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 16/31] 10.222.0.36 () {64 vars in 1283 bytes} [Thu Aug 18 14:44:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:44:36.924836 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-5d2ce2a5-ef61-44a2-ad27-5a278236572e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:44:36.957062 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-5d2ce2a5-ef61-44a2-ad27-5a278236572e admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035717 Aug 18 14:44:36.958039 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 16/32] 10.222.0.36 () {64 vars in 1333 bytes} [Thu Aug 18 14:44:36 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:44:39.418375 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-cf2325a4-96d7-4630-8961-fb6fc71f7e24 admin admin] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:44:39.419398 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-cf2325a4-96d7-4630-8961-fb6fc71f7e24 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 18 14:44:39.419989 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 17/33] 10.222.0.36 () {54 vars in 931 bytes} [Thu Aug 18 14:44:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:44:39.959549 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-cb16e696-43b5-4158-b102-f3e29a65c336 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "os-flavor-access:is_public": true, "disk": 160, "id": "5"}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:44:39.986667 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-cb16e696-43b5-4158-b102-f3e29a65c336 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.560667 Aug 18 14:44:39.987171 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 17/34] 10.222.0.36 () {64 vars in 1283 bytes} [Thu Aug 18 14:44:39 2022] POST /compute/v2.1/flavors => generated 408 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 14:44:40.000014 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-21040d00-b551-4c81-a365-8db5a3c623af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:44:40.028433 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-21040d00-b551-4c81-a365-8db5a3c623af admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032248 Aug 18 14:44:40.044738 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 18/35] 10.222.0.36 () {64 vars in 1333 bytes} [Thu Aug 18 14:44:39 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:44:59.350405 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-cb16e696-43b5-4158-b102-f3e29a65c336 admin admin] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:44:59.351991 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-cb16e696-43b5-4158-b102-f3e29a65c336 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002001 Aug 18 14:44:59.352399 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 18/36] 10.222.0.36 () {54 vars in 931 bytes} [Thu Aug 18 14:44:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:44:59.362994 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG dbcounter [-] [117154] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=117154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:44:59.752571 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-b4718ca9-8c23-4b21-8975-a8c217d2fa15 admin admin] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:44:59.771755 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-b4718ca9-8c23-4b21-8975-a8c217d2fa15 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.413126 Aug 18 14:44:59.772303 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 19/37] 10.222.0.36 () {60 vars in 1292 bytes} [Thu Aug 18 14:44:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:45:00.843468 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-cb16e696-43b5-4158-b102-f3e29a65c336 admin admin] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:45:00.844509 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-cb16e696-43b5-4158-b102-f3e29a65c336 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 18 14:45:00.844903 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 19/38] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Aug 18 14:45:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:45:01.358621 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e6c6b9a8-d28a-4c70-8ba1-7e5bbb62c671 admin admin] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:45:01.364252 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-e6c6b9a8-d28a-4c70-8ba1-7e5bbb62c671 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 18 14:45:01.367631 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e6c6b9a8-d28a-4c70-8ba1-7e5bbb62c671 admin admin] Request method failure captured: Aug 18 14:45:01.367631 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 18 14:45:01.367631 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: Accept: application/json Aug 18 14:45:01.367631 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: Accept-Encoding: gzip, deflate Aug 18 14:45:01.367631 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: Connection: keep-alive Aug 18 14:45:01.367631 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: Content-Length: 0 Aug 18 14:45:01.367631 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: Host: 10.222.0.36 Aug 18 14:45:01.367631 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: Openstack-Api-Version: compute 2.90 Aug 18 14:45:01.367631 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None Aug 18 14:45:01.367631 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: User-Agent: python-novaclient Aug 18 14:45:01.367631 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABi_lBsotOhMMgLjsgcDufUJ3Sc3GICWqY2Hn8IzwWZyf9OA9GxBVIyN1F7CQ8Igzp5ns2LGjo1iOtfpFTNJ2qLG5gdr6ikUVAtFsE3rkR9lUA2hzjp8j5NKMz8VoyF6GLf3SjbvjdkF65AJB5CybR6Fshn-2Axpw_XiBMuyC8Bw8CtCoQ Aug 18 14:45:01.367631 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Domain-Id: None Aug 18 14:45:01.367631 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Domain-Name: None Aug 18 14:45:01.367631 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed Aug 18 14:45:01.367631 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True Aug 18 14:45:01.367631 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 14:45:01.367631 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default Aug 18 14:45:01.367631 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default Aug 18 14:45:01.367631 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Project-Id: fa81e49fae72473b99b445418d4fe5de Aug 18 14:45:01.367631 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Project-Name: admin Aug 18 14:45:01.367631 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Role: member,reader,admin Aug 18 14:45:01.367631 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Roles: member,reader,admin Aug 18 14:45:01.369269 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fa81e49fae72473b99b445418d4fe5de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fa81e49fae72473b99b445418d4fe5de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fa81e49fae72473b99b445418d4fe5de", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fa81e49fae72473b99b445418d4fe5de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:45:01.369269 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Tenant: admin Aug 18 14:45:01.369269 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Tenant-Id: fa81e49fae72473b99b445418d4fe5de Aug 18 14:45:01.369269 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Tenant-Name: admin Aug 18 14:45:01.369269 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-User: admin Aug 18 14:45:01.369269 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default Aug 18 14:45:01.369269 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default Aug 18 14:45:01.369269 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-User-Id: 5064296cd28f403599a02675cb0c7103 Aug 18 14:45:01.369269 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-User-Name: admin Aug 18 14:45:01.369269 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: method: > Aug 18 14:45:01.369269 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: exception: Flavor 42 could not be found. Aug 18 14:45:01.369269 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: action_args: {'id': '42'} Aug 18 14:45:01.369269 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:45:01.369269 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:45:01.372471 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 14:45:01.372471 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 14:45:01.372471 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 14:45:01.372471 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 14:45:01.372471 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 14:45:01.372471 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 14:45:01.372471 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 14:45:01.372471 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 14:45:01.372471 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 14:45:01.372471 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:45:01.372471 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 14:45:01.372471 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 14:45:01.372471 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 18 14:45:01.372471 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Aug 18 14:45:01.372471 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:45:01.372471 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Aug 18 14:45:01.372471 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:45:01.372471 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:45:01.372471 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:45:01.373890 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:45:01.373890 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:45:01.373890 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:45:01.373890 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:45:01.373890 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 14:45:01.373890 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:45:01.373890 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 18 14:45:01.373890 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Aug 18 14:45:01.373890 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:45:01.373890 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Aug 18 14:45:01.373890 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:45:01.373890 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:45:01.373890 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:45:01.373890 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:45:01.373890 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:45:01.373890 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 18 14:45:01.373890 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Aug 18 14:45:01.373890 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e6c6b9a8-d28a-4c70-8ba1-7e5bbb62c671 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:45:01.375156 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-e6c6b9a8-d28a-4c70-8ba1-7e5bbb62c671 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.387341 Aug 18 14:45:01.375156 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 20/39] 10.222.0.36 () {60 vars in 1190 bytes} [Thu Aug 18 14:45:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 14:45:01.378706 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-b2835d79-0e61-4060-b31a-d49d53cd2abe admin admin] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:45:01.383325 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG dbcounter [-] [117153] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=117153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:45:01.403793 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-b2835d79-0e61-4060-b31a-d49d53cd2abe admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028549 Aug 18 14:45:01.404349 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 20/40] 10.222.0.36 () {60 vars in 1210 bytes} [Thu Aug 18 14:45:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:45:01.414743 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-4a3501fb-6fcf-40fa-a939-89ec6a891998 admin admin] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:45:01.438627 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-4a3501fb-6fcf-40fa-a939-89ec6a891998 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028120 Aug 18 14:45:01.439165 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 21/41] 10.222.0.36 () {60 vars in 1210 bytes} [Thu Aug 18 14:45:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:45:01.448511 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-969e1b90-2cea-42ae-ae3b-e16b68fc725d admin admin] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:45:01.454804 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-969e1b90-2cea-42ae-ae3b-e16b68fc725d admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 18 14:45:01.458022 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-969e1b90-2cea-42ae-ae3b-e16b68fc725d admin admin] Request method failure captured: Aug 18 14:45:01.458022 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 18 14:45:01.458022 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: Accept: application/json Aug 18 14:45:01.458022 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: Accept-Encoding: gzip, deflate Aug 18 14:45:01.458022 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: Connection: keep-alive Aug 18 14:45:01.458022 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: Content-Length: 0 Aug 18 14:45:01.458022 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: Host: 10.222.0.36 Aug 18 14:45:01.458022 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: Openstack-Api-Version: compute 2.90 Aug 18 14:45:01.458022 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None Aug 18 14:45:01.458022 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: User-Agent: python-novaclient Aug 18 14:45:01.458022 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABi_lBsotOhMMgLjsgcDufUJ3Sc3GICWqY2Hn8IzwWZyf9OA9GxBVIyN1F7CQ8Igzp5ns2LGjo1iOtfpFTNJ2qLG5gdr6ikUVAtFsE3rkR9lUA2hzjp8j5NKMz8VoyF6GLf3SjbvjdkF65AJB5CybR6Fshn-2Axpw_XiBMuyC8Bw8CtCoQ Aug 18 14:45:01.458022 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Domain-Id: None Aug 18 14:45:01.458022 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Domain-Name: None Aug 18 14:45:01.458022 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed Aug 18 14:45:01.458022 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True Aug 18 14:45:01.458022 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 14:45:01.458022 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default Aug 18 14:45:01.458022 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default Aug 18 14:45:01.458022 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Project-Id: fa81e49fae72473b99b445418d4fe5de Aug 18 14:45:01.458022 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Project-Name: admin Aug 18 14:45:01.458022 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Role: member,reader,admin Aug 18 14:45:01.458022 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Roles: member,reader,admin Aug 18 14:45:01.459389 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fa81e49fae72473b99b445418d4fe5de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fa81e49fae72473b99b445418d4fe5de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fa81e49fae72473b99b445418d4fe5de", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fa81e49fae72473b99b445418d4fe5de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:45:01.459389 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Tenant: admin Aug 18 14:45:01.459389 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Tenant-Id: fa81e49fae72473b99b445418d4fe5de Aug 18 14:45:01.459389 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Tenant-Name: admin Aug 18 14:45:01.459389 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-User: admin Aug 18 14:45:01.459389 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default Aug 18 14:45:01.459389 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default Aug 18 14:45:01.459389 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-User-Id: 5064296cd28f403599a02675cb0c7103 Aug 18 14:45:01.459389 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-User-Name: admin Aug 18 14:45:01.459389 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: method: > Aug 18 14:45:01.459389 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: exception: Flavor 42 could not be found. Aug 18 14:45:01.459389 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: action_args: {'id': '42'} Aug 18 14:45:01.459389 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:45:01.459389 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:45:01.460884 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 14:45:01.460884 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 14:45:01.460884 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 14:45:01.460884 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 14:45:01.460884 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 14:45:01.460884 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 14:45:01.460884 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 14:45:01.460884 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 14:45:01.460884 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 14:45:01.460884 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:45:01.460884 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 14:45:01.460884 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 14:45:01.460884 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 18 14:45:01.460884 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Aug 18 14:45:01.460884 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:45:01.460884 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Aug 18 14:45:01.460884 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:45:01.460884 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:45:01.460884 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:45:01.462351 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:45:01.462351 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:45:01.462351 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:45:01.462351 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:45:01.462351 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 14:45:01.462351 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:45:01.462351 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 18 14:45:01.462351 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Aug 18 14:45:01.462351 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:45:01.462351 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Aug 18 14:45:01.462351 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:45:01.462351 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:45:01.462351 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:45:01.462351 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:45:01.462351 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:45:01.462351 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 18 14:45:01.462351 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Aug 18 14:45:01.462351 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-969e1b90-2cea-42ae-ae3b-e16b68fc725d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:45:01.463544 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-969e1b90-2cea-42ae-ae3b-e16b68fc725d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014542 Aug 18 14:45:01.463544 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 21/42] 10.222.0.36 () {60 vars in 1190 bytes} [Thu Aug 18 14:45:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 18 14:45:02.431086 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-4a3501fb-6fcf-40fa-a939-89ec6a891998 admin admin] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:45:02.432146 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-4a3501fb-6fcf-40fa-a939-89ec6a891998 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 18 14:45:02.432535 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 22/43] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Aug 18 14:45:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:45:02.963618 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-1d75dd31-880f-4a5a-bc29-db3e5537896c admin admin] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:45:02.969126 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-1d75dd31-880f-4a5a-bc29-db3e5537896c admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 18 14:45:02.970645 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-1d75dd31-880f-4a5a-bc29-db3e5537896c admin admin] Request method failure captured: Aug 18 14:45:02.970645 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 18 14:45:02.970645 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: Accept: application/json Aug 18 14:45:02.970645 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: Accept-Encoding: gzip, deflate Aug 18 14:45:02.970645 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: Connection: keep-alive Aug 18 14:45:02.970645 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: Content-Length: 0 Aug 18 14:45:02.970645 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: Host: 10.222.0.36 Aug 18 14:45:02.970645 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: Openstack-Api-Version: compute 2.90 Aug 18 14:45:02.970645 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None Aug 18 14:45:02.970645 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: User-Agent: python-novaclient Aug 18 14:45:02.970645 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABi_lBuFlZ3K_cVY-IjiwFAfHZUYcqhgUUI-XclOf2OwrANTqBo5ZHd-H8ol_MwFdfi1MniVWxAMA9uNoR8rsMy0ecDhjOvsBjNy5VGX-W85MzvhuMCULDzBisKK-2WSzX_Kf3Q6cscOTu14ChjRGxNqRzAnWcFQ-hkA9bLWVekXDxWqzg Aug 18 14:45:02.970645 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Domain-Id: None Aug 18 14:45:02.970645 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Domain-Name: None Aug 18 14:45:02.970645 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed Aug 18 14:45:02.970645 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True Aug 18 14:45:02.970645 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 14:45:02.970645 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default Aug 18 14:45:02.970645 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default Aug 18 14:45:02.970645 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Project-Id: fa81e49fae72473b99b445418d4fe5de Aug 18 14:45:02.970645 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Project-Name: admin Aug 18 14:45:02.970645 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Role: member,reader,admin Aug 18 14:45:02.970645 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Roles: member,reader,admin Aug 18 14:45:02.971986 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fa81e49fae72473b99b445418d4fe5de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fa81e49fae72473b99b445418d4fe5de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fa81e49fae72473b99b445418d4fe5de", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fa81e49fae72473b99b445418d4fe5de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:45:02.971986 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Tenant: admin Aug 18 14:45:02.971986 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Tenant-Id: fa81e49fae72473b99b445418d4fe5de Aug 18 14:45:02.971986 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Tenant-Name: admin Aug 18 14:45:02.971986 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-User: admin Aug 18 14:45:02.971986 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default Aug 18 14:45:02.971986 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default Aug 18 14:45:02.971986 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-User-Id: 5064296cd28f403599a02675cb0c7103 Aug 18 14:45:02.971986 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-User-Name: admin Aug 18 14:45:02.971986 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: method: > Aug 18 14:45:02.971986 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: exception: Flavor 84 could not be found. Aug 18 14:45:02.971986 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: action_args: {'id': '84'} Aug 18 14:45:02.971986 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:45:02.971986 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:45:02.973925 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 14:45:02.973925 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 14:45:02.973925 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 14:45:02.973925 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 14:45:02.973925 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 14:45:02.973925 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 14:45:02.973925 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 14:45:02.973925 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 14:45:02.973925 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 14:45:02.973925 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:45:02.973925 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 14:45:02.973925 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 14:45:02.973925 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 18 14:45:02.973925 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Aug 18 14:45:02.973925 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:45:02.973925 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Aug 18 14:45:02.973925 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:45:02.973925 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:45:02.973925 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:45:02.975192 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:45:02.975192 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:45:02.975192 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:45:02.975192 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:45:02.975192 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 14:45:02.975192 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:45:02.975192 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 18 14:45:02.975192 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Aug 18 14:45:02.975192 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:45:02.975192 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Aug 18 14:45:02.975192 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:45:02.975192 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:45:02.975192 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:45:02.975192 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:45:02.975192 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:45:02.975192 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 18 14:45:02.975192 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Aug 18 14:45:02.975192 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-1d75dd31-880f-4a5a-bc29-db3e5537896c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:45:02.976673 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-1d75dd31-880f-4a5a-bc29-db3e5537896c admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.401368 Aug 18 14:45:02.976673 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 22/44] 10.222.0.36 () {60 vars in 1190 bytes} [Thu Aug 18 14:45:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 14:45:02.981840 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-7ba27783-8903-4277-ac75-e522967f9f42 admin admin] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:45:02.997463 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-7ba27783-8903-4277-ac75-e522967f9f42 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019242 Aug 18 14:45:02.997989 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 23/45] 10.222.0.36 () {60 vars in 1210 bytes} [Thu Aug 18 14:45:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:45:03.008196 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-af2c99d6-f65b-4780-8b75-a1bf0ec40867 admin admin] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:45:03.022934 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-af2c99d6-f65b-4780-8b75-a1bf0ec40867 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019160 Aug 18 14:45:03.023457 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 23/46] 10.222.0.36 () {60 vars in 1210 bytes} [Thu Aug 18 14:45:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:45:03.032747 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1c555f52-c94f-41be-b1bf-c99012ff4ebc admin admin] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:45:03.038033 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-1c555f52-c94f-41be-b1bf-c99012ff4ebc admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 18 14:45:03.039529 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1c555f52-c94f-41be-b1bf-c99012ff4ebc admin admin] Request method failure captured: Aug 18 14:45:03.039529 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 18 14:45:03.039529 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: Accept: application/json Aug 18 14:45:03.039529 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: Accept-Encoding: gzip, deflate Aug 18 14:45:03.039529 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: Connection: keep-alive Aug 18 14:45:03.039529 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: Content-Length: 0 Aug 18 14:45:03.039529 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: Host: 10.222.0.36 Aug 18 14:45:03.039529 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: Openstack-Api-Version: compute 2.90 Aug 18 14:45:03.039529 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None Aug 18 14:45:03.039529 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: User-Agent: python-novaclient Aug 18 14:45:03.039529 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABi_lBuFlZ3K_cVY-IjiwFAfHZUYcqhgUUI-XclOf2OwrANTqBo5ZHd-H8ol_MwFdfi1MniVWxAMA9uNoR8rsMy0ecDhjOvsBjNy5VGX-W85MzvhuMCULDzBisKK-2WSzX_Kf3Q6cscOTu14ChjRGxNqRzAnWcFQ-hkA9bLWVekXDxWqzg Aug 18 14:45:03.039529 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Domain-Id: None Aug 18 14:45:03.039529 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Domain-Name: None Aug 18 14:45:03.039529 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed Aug 18 14:45:03.039529 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True Aug 18 14:45:03.039529 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 14:45:03.039529 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default Aug 18 14:45:03.039529 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default Aug 18 14:45:03.039529 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Project-Id: fa81e49fae72473b99b445418d4fe5de Aug 18 14:45:03.039529 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Project-Name: admin Aug 18 14:45:03.039529 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Role: member,reader,admin Aug 18 14:45:03.039529 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Roles: member,reader,admin Aug 18 14:45:03.041047 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fa81e49fae72473b99b445418d4fe5de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fa81e49fae72473b99b445418d4fe5de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fa81e49fae72473b99b445418d4fe5de", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fa81e49fae72473b99b445418d4fe5de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:45:03.041047 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Tenant: admin Aug 18 14:45:03.041047 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Tenant-Id: fa81e49fae72473b99b445418d4fe5de Aug 18 14:45:03.041047 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Tenant-Name: admin Aug 18 14:45:03.041047 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-User: admin Aug 18 14:45:03.041047 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default Aug 18 14:45:03.041047 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default Aug 18 14:45:03.041047 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-User-Id: 5064296cd28f403599a02675cb0c7103 Aug 18 14:45:03.041047 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-User-Name: admin Aug 18 14:45:03.041047 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: method: > Aug 18 14:45:03.041047 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: exception: Flavor 84 could not be found. Aug 18 14:45:03.041047 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: action_args: {'id': '84'} Aug 18 14:45:03.041047 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:45:03.041047 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:45:03.041902 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 14:45:03.041902 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 14:45:03.041902 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 14:45:03.041902 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 14:45:03.041902 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 14:45:03.041902 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 14:45:03.041902 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 14:45:03.041902 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 14:45:03.041902 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 14:45:03.041902 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:45:03.041902 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 14:45:03.041902 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 14:45:03.041902 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 18 14:45:03.041902 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Aug 18 14:45:03.041902 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:45:03.041902 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Aug 18 14:45:03.041902 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:45:03.041902 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:45:03.041902 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:45:03.043343 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:45:03.043343 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:45:03.043343 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:45:03.043343 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:45:03.043343 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 14:45:03.043343 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:45:03.043343 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 18 14:45:03.043343 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Aug 18 14:45:03.043343 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:45:03.043343 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Aug 18 14:45:03.043343 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:45:03.043343 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:45:03.043343 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:45:03.043343 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:45:03.043343 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:45:03.043343 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 18 14:45:03.043343 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Aug 18 14:45:03.043343 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1c555f52-c94f-41be-b1bf-c99012ff4ebc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:45:03.044672 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-1c555f52-c94f-41be-b1bf-c99012ff4ebc admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011688 Aug 18 14:45:03.044672 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 24/47] 10.222.0.36 () {60 vars in 1190 bytes} [Thu Aug 18 14:45:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 18 14:45:04.016015 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-af2c99d6-f65b-4780-8b75-a1bf0ec40867 admin admin] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:45:04.017007 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-af2c99d6-f65b-4780-8b75-a1bf0ec40867 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001589 Aug 18 14:45:04.017385 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 24/48] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Aug 18 14:45:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:45:04.539668 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-ea8b51e8-b8e6-4310-92ab-ced33df17664 admin admin] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:45:04.545589 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-ea8b51e8-b8e6-4310-92ab-ced33df17664 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 18 14:45:04.547103 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-ea8b51e8-b8e6-4310-92ab-ced33df17664 admin admin] Request method failure captured: Aug 18 14:45:04.547103 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 18 14:45:04.547103 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: Accept: application/json Aug 18 14:45:04.547103 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: Accept-Encoding: gzip, deflate Aug 18 14:45:04.547103 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: Connection: keep-alive Aug 18 14:45:04.547103 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: Content-Length: 0 Aug 18 14:45:04.547103 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: Host: 10.222.0.36 Aug 18 14:45:04.547103 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: Openstack-Api-Version: compute 2.90 Aug 18 14:45:04.547103 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None Aug 18 14:45:04.547103 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: User-Agent: python-novaclient Aug 18 14:45:04.547103 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABi_lBv05LBKFnaIQlzGyzJyuKgw_7J2GReZDh-MudYeHGLAhfxwDoqymKGK_PKNiCpXttCJ_kvvay84zfXB0es4EECI25KuzjNAAMKoOdZBQk5Qk98k7oM1A1gBmZNwkQK1f3CxGmlspOA725AHjP5OmAR4lmTYGoCxLbgjjHghMf_xho Aug 18 14:45:04.547103 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Domain-Id: None Aug 18 14:45:04.547103 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Domain-Name: None Aug 18 14:45:04.547103 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed Aug 18 14:45:04.547103 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True Aug 18 14:45:04.547103 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 14:45:04.547103 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default Aug 18 14:45:04.547103 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default Aug 18 14:45:04.547103 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Project-Id: fa81e49fae72473b99b445418d4fe5de Aug 18 14:45:04.547103 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Project-Name: admin Aug 18 14:45:04.547103 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Role: member,reader,admin Aug 18 14:45:04.547103 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Roles: member,reader,admin Aug 18 14:45:04.548567 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fa81e49fae72473b99b445418d4fe5de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fa81e49fae72473b99b445418d4fe5de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fa81e49fae72473b99b445418d4fe5de", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fa81e49fae72473b99b445418d4fe5de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:45:04.548567 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Tenant: admin Aug 18 14:45:04.548567 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Tenant-Id: fa81e49fae72473b99b445418d4fe5de Aug 18 14:45:04.548567 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-Tenant-Name: admin Aug 18 14:45:04.548567 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-User: admin Aug 18 14:45:04.548567 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default Aug 18 14:45:04.548567 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default Aug 18 14:45:04.548567 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-User-Id: 5064296cd28f403599a02675cb0c7103 Aug 18 14:45:04.548567 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: X-User-Name: admin Aug 18 14:45:04.548567 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: method: > Aug 18 14:45:04.548567 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: exception: Flavor 451 could not be found. Aug 18 14:45:04.548567 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: action_args: {'id': '451'} Aug 18 14:45:04.548567 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:45:04.548567 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:45:04.549399 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 14:45:04.549399 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 14:45:04.549399 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 14:45:04.549399 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 14:45:04.549399 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 14:45:04.549399 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 14:45:04.549399 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 14:45:04.549399 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 14:45:04.549399 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 14:45:04.549399 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:45:04.549399 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 14:45:04.549399 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 14:45:04.549399 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 18 14:45:04.549399 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Aug 18 14:45:04.549399 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:45:04.549399 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Aug 18 14:45:04.549399 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:45:04.549399 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:45:04.549399 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:45:04.550464 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:45:04.550464 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:45:04.550464 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:45:04.550464 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:45:04.550464 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 14:45:04.550464 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:45:04.550464 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 18 14:45:04.550464 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Aug 18 14:45:04.550464 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:45:04.550464 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Aug 18 14:45:04.550464 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:45:04.550464 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:45:04.550464 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:45:04.550464 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:45:04.550464 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:45:04.550464 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 18 14:45:04.550464 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Aug 18 14:45:04.550464 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-ea8b51e8-b8e6-4310-92ab-ced33df17664 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:45:04.551566 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-ea8b51e8-b8e6-4310-92ab-ced33df17664 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.393186 Aug 18 14:45:04.551566 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 25/49] 10.222.0.36 () {60 vars in 1193 bytes} [Thu Aug 18 14:45:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 14:45:04.558735 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8508c177-c716-4ee5-9df9-7018f4bdcac0 admin admin] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:45:04.573759 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-8508c177-c716-4ee5-9df9-7018f4bdcac0 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018573 Aug 18 14:45:04.574286 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 25/50] 10.222.0.36 () {60 vars in 1210 bytes} [Thu Aug 18 14:45:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:45:04.583749 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-903dd26b-9c51-475c-b0fe-366236691763 admin admin] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:45:04.599323 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-903dd26b-9c51-475c-b0fe-366236691763 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019017 Aug 18 14:45:04.599920 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 26/51] 10.222.0.36 () {60 vars in 1210 bytes} [Thu Aug 18 14:45:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:45:04.609980 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-351ac73b-98c1-4e0c-94d4-1372a24aebe2 admin admin] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:45:04.615401 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-351ac73b-98c1-4e0c-94d4-1372a24aebe2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 18 14:45:04.616930 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-351ac73b-98c1-4e0c-94d4-1372a24aebe2 admin admin] Request method failure captured: Aug 18 14:45:04.616930 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 18 14:45:04.616930 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: Accept: application/json Aug 18 14:45:04.616930 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: Accept-Encoding: gzip, deflate Aug 18 14:45:04.616930 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: Connection: keep-alive Aug 18 14:45:04.616930 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: Content-Length: 0 Aug 18 14:45:04.616930 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: Host: 10.222.0.36 Aug 18 14:45:04.616930 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: Openstack-Api-Version: compute 2.90 Aug 18 14:45:04.616930 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None Aug 18 14:45:04.616930 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: User-Agent: python-novaclient Aug 18 14:45:04.616930 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABi_lBv05LBKFnaIQlzGyzJyuKgw_7J2GReZDh-MudYeHGLAhfxwDoqymKGK_PKNiCpXttCJ_kvvay84zfXB0es4EECI25KuzjNAAMKoOdZBQk5Qk98k7oM1A1gBmZNwkQK1f3CxGmlspOA725AHjP5OmAR4lmTYGoCxLbgjjHghMf_xho Aug 18 14:45:04.616930 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Domain-Id: None Aug 18 14:45:04.616930 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Domain-Name: None Aug 18 14:45:04.616930 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed Aug 18 14:45:04.616930 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True Aug 18 14:45:04.616930 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 14:45:04.616930 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default Aug 18 14:45:04.616930 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default Aug 18 14:45:04.616930 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Project-Id: fa81e49fae72473b99b445418d4fe5de Aug 18 14:45:04.616930 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Project-Name: admin Aug 18 14:45:04.616930 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Role: member,reader,admin Aug 18 14:45:04.616930 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Roles: member,reader,admin Aug 18 14:45:04.618467 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fa81e49fae72473b99b445418d4fe5de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fa81e49fae72473b99b445418d4fe5de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fa81e49fae72473b99b445418d4fe5de", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fa81e49fae72473b99b445418d4fe5de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:45:04.618467 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Tenant: admin Aug 18 14:45:04.618467 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Tenant-Id: fa81e49fae72473b99b445418d4fe5de Aug 18 14:45:04.618467 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-Tenant-Name: admin Aug 18 14:45:04.618467 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-User: admin Aug 18 14:45:04.618467 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default Aug 18 14:45:04.618467 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default Aug 18 14:45:04.618467 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-User-Id: 5064296cd28f403599a02675cb0c7103 Aug 18 14:45:04.618467 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: X-User-Name: admin Aug 18 14:45:04.618467 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: method: > Aug 18 14:45:04.618467 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: exception: Flavor 451 could not be found. Aug 18 14:45:04.618467 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: action_args: {'id': '451'} Aug 18 14:45:04.618467 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:45:04.618467 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:45:04.619473 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 14:45:04.619473 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 14:45:04.619473 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 14:45:04.619473 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 14:45:04.619473 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 14:45:04.619473 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 14:45:04.619473 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 14:45:04.619473 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 14:45:04.619473 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 14:45:04.619473 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:45:04.619473 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 14:45:04.619473 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 14:45:04.619473 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 18 14:45:04.619473 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Aug 18 14:45:04.619473 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:45:04.619473 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Aug 18 14:45:04.619473 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:45:04.619473 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:45:04.619473 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:45:04.620808 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:45:04.620808 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:45:04.620808 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:45:04.620808 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:45:04.620808 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 14:45:04.620808 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:45:04.620808 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 18 14:45:04.620808 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Aug 18 14:45:04.620808 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:45:04.620808 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Aug 18 14:45:04.620808 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:45:04.620808 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:45:04.620808 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:45:04.620808 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:45:04.620808 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:45:04.620808 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 18 14:45:04.620808 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Aug 18 14:45:04.620808 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-351ac73b-98c1-4e0c-94d4-1372a24aebe2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:45:04.622100 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-351ac73b-98c1-4e0c-94d4-1372a24aebe2 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011905 Aug 18 14:45:04.622100 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 26/52] 10.222.0.36 () {60 vars in 1193 bytes} [Thu Aug 18 14:45:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 14:45:05.615001 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-903dd26b-9c51-475c-b0fe-366236691763 admin admin] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:45:05.616647 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-903dd26b-9c51-475c-b0fe-366236691763 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 18 14:45:05.617145 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 27/53] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Aug 18 14:45:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:45:06.176633 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-a6bcbc00-56e9-42a0-bbcf-4c2a6d35f7ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:45:06.196584 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-a6bcbc00-56e9-42a0-bbcf-4c2a6d35f7ef admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.436236 Aug 18 14:45:06.197116 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 27/54] 10.222.0.36 () {64 vars in 1235 bytes} [Thu Aug 18 14:45:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:45:07.182267 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-903dd26b-9c51-475c-b0fe-366236691763 admin admin] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:45:07.183279 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-903dd26b-9c51-475c-b0fe-366236691763 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 18 14:45:07.183698 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 28/55] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Aug 18 14:45:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:45:07.718263 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-dc9c32a7-1d06-41d9-bee7-bf681a09d71f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:45:07.736692 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-dc9c32a7-1d06-41d9-bee7-bf681a09d71f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.416316 Aug 18 14:45:07.737167 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 28/56] 10.222.0.36 () {64 vars in 1235 bytes} [Thu Aug 18 14:45:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:45:08.720107 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-903dd26b-9c51-475c-b0fe-366236691763 admin admin] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:45:08.721098 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-903dd26b-9c51-475c-b0fe-366236691763 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 18 14:45:08.721495 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 29/57] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Aug 18 14:45:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:45:09.265520 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-a3a761a3-6745-45e5-864a-e2541cededdd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:45:09.284350 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-a3a761a3-6745-45e5-864a-e2541cededdd admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.414951 Aug 18 14:45:09.284898 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 29/58] 10.222.0.36 () {64 vars in 1235 bytes} [Thu Aug 18 14:45:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:45:10.264588 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-903dd26b-9c51-475c-b0fe-366236691763 admin admin] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:45:10.265628 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-903dd26b-9c51-475c-b0fe-366236691763 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Aug 18 14:45:10.266021 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 30/59] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Aug 18 14:45:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:45:10.783562 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-08ab1f5d-ecb6-42a0-ab85-4e01afa71cd9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:45:10.802338 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-08ab1f5d-ecb6-42a0-ab85-4e01afa71cd9 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.398262 Aug 18 14:45:10.802887 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 30/60] 10.222.0.36 () {64 vars in 1235 bytes} [Thu Aug 18 14:45:10 2022] POST /compute/v2.1/flavors => generated 409 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:45:11.760819 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-903dd26b-9c51-475c-b0fe-366236691763 admin admin] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:45:11.761826 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-903dd26b-9c51-475c-b0fe-366236691763 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 18 14:45:11.762221 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 31/61] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Aug 18 14:45:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:45:12.286623 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c8609835-42d4-4766-91bd-753110830240 admin admin] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:45:12.306686 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c8609835-42d4-4766-91bd-753110830240 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.407799 Aug 18 14:45:12.307229 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 31/62] 10.222.0.36 () {60 vars in 1202 bytes} [Thu Aug 18 14:45:11 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:46:08.077564 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-903dd26b-9c51-475c-b0fe-366236691763 admin admin] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:46:08.078566 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-903dd26b-9c51-475c-b0fe-366236691763 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 18 14:46:08.078966 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 32/63] 10.222.0.36 () {54 vars in 931 bytes} [Thu Aug 18 14:46:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:46:08.091050 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG dbcounter [-] [117153] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=117153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:46:08.503043 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-18e59786-283b-400a-9ff8-d2b14d379ce0 admin admin] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:46:08.525210 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-18e59786-283b-400a-9ff8-d2b14d379ce0 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.438716 Aug 18 14:46:08.525686 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 32/64] 10.222.0.36 () {60 vars in 1292 bytes} [Thu Aug 18 14:46:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:46:08.547041 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG dbcounter [-] [117154] Writing DB stats nova_api:SELECT=14 {{(pid=117154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:46:08.551005 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-4176c71e-8b3b-4645-b077-416e621490ca admin admin] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:46:08.559107 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-4176c71e-8b3b-4645-b077-416e621490ca admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013649 Aug 18 14:46:08.559648 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 33/65] 10.222.0.36 () {60 vars in 1283 bytes} [Thu Aug 18 14:46:08 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:46:08.572309 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-ca1e4f37-c04d-4bd6-a6a1-fafb2d57ce6d admin admin] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:46:08.580125 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-ca1e4f37-c04d-4bd6-a6a1-fafb2d57ce6d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011440 Aug 18 14:46:08.580654 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 33/66] 10.222.0.36 () {60 vars in 1286 bytes} [Thu Aug 18 14:46:08 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:46:08.593457 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c62e394d-a796-40f2-95da-ca4cde141174 admin admin] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:46:08.601947 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-c62e394d-a796-40f2-95da-ca4cde141174 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012512 Aug 18 14:46:08.602525 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 34/67] 10.222.0.36 () {60 vars in 1286 bytes} [Thu Aug 18 14:46:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:46:08.614694 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c5e0829e-a599-4b2e-a701-1acbbbd4faa4 admin admin] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:46:08.622780 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c5e0829e-a599-4b2e-a701-1acbbbd4faa4 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012051 Aug 18 14:46:08.623314 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 34/68] 10.222.0.36 () {60 vars in 1283 bytes} [Thu Aug 18 14:46:08 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:49:22.238001 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c62e394d-a796-40f2-95da-ca4cde141174 admin admin] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:49:22.239007 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-c62e394d-a796-40f2-95da-ca4cde141174 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 18 14:49:22.239418 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 35/69] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Aug 18 14:49:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:49:22.378846 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG dbcounter [-] [117153] Writing DB stats nova_api:SELECT=6 {{(pid=117153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:49:22.542624 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-275758cb-699a-4f70-81ee-5407c18545f2 admin admin] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:49:22.545073 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 14:49:22.545073 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: warnings.warn(msg) Aug 18 14:49:22.546846 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-275758cb-699a-4f70-81ee-5407c18545f2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:49:22.547326 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-275758cb-699a-4f70-81ee-5407c18545f2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:49:22.547783 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-275758cb-699a-4f70-81ee-5407c18545f2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:49:22.548513 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-275758cb-699a-4f70-81ee-5407c18545f2 admin admin] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:49:22.548958 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-275758cb-699a-4f70-81ee-5407c18545f2 admin admin] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:49:22.549375 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-275758cb-699a-4f70-81ee-5407c18545f2 admin admin] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:49:22.584842 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-275758cb-699a-4f70-81ee-5407c18545f2 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.207454 Aug 18 14:49:22.585421 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 35/70] 10.222.0.36 () {60 vars in 1193 bytes} [Thu Aug 18 14:49:22 2022] GET /compute/v2.1/os-services => generated 791 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:49:23.433682 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c62e394d-a796-40f2-95da-ca4cde141174 admin admin] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:49:23.434710 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-c62e394d-a796-40f2-95da-ca4cde141174 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Aug 18 14:49:23.435108 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 36/71] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Aug 18 14:49:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:49:23.628523 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-5e02ec99-e4a2-4634-b5c9-c3c1fe878de2 admin admin] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:49:23.631163 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 14:49:23.631163 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: warnings.warn(msg) Aug 18 14:49:23.632294 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5e02ec99-e4a2-4634-b5c9-c3c1fe878de2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:49:23.632797 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5e02ec99-e4a2-4634-b5c9-c3c1fe878de2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:49:23.633215 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5e02ec99-e4a2-4634-b5c9-c3c1fe878de2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:49:23.634595 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5e02ec99-e4a2-4634-b5c9-c3c1fe878de2 admin admin] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:49:23.635040 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5e02ec99-e4a2-4634-b5c9-c3c1fe878de2 admin admin] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:49:23.635454 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5e02ec99-e4a2-4634-b5c9-c3c1fe878de2 admin admin] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:49:23.655797 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-5e02ec99-e4a2-4634-b5c9-c3c1fe878de2 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080689 Aug 18 14:49:23.656279 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 36/72] 10.222.0.36 () {60 vars in 1193 bytes} [Thu Aug 18 14:49:23 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:49:34.925940 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c62e394d-a796-40f2-95da-ca4cde141174 admin admin] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:49:34.926943 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-c62e394d-a796-40f2-95da-ca4cde141174 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 18 14:49:34.927339 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 37/73] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Aug 18 14:49:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:49:35.073300 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG dbcounter [-] [117153] Writing DB stats nova_cell0:SELECT=4 {{(pid=117153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:49:35.074014 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG dbcounter [-] [117153] Writing DB stats nova_cell1:SELECT=4 {{(pid=117153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:49:35.074623 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG dbcounter [-] [117153] Writing DB stats nova_api:SELECT=8 {{(pid=117153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:49:35.125446 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c30faa8c-b92d-48f1-a053-be061db4cf9e admin admin] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:49:35.127838 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 14:49:35.127838 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: warnings.warn(msg) Aug 18 14:49:35.129033 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c30faa8c-b92d-48f1-a053-be061db4cf9e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:49:35.129506 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c30faa8c-b92d-48f1-a053-be061db4cf9e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:49:35.130199 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c30faa8c-b92d-48f1-a053-be061db4cf9e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:49:35.130912 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c30faa8c-b92d-48f1-a053-be061db4cf9e admin admin] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:49:35.131357 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c30faa8c-b92d-48f1-a053-be061db4cf9e admin admin] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:49:35.131796 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c30faa8c-b92d-48f1-a053-be061db4cf9e admin admin] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:49:35.158283 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c30faa8c-b92d-48f1-a053-be061db4cf9e admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.089301 Aug 18 14:49:35.158860 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 37/74] 10.222.0.36 () {60 vars in 1193 bytes} [Thu Aug 18 14:49:35 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:49:36.014800 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c62e394d-a796-40f2-95da-ca4cde141174 admin admin] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:49:36.015906 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-c62e394d-a796-40f2-95da-ca4cde141174 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 18 14:49:36.016371 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 38/75] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Aug 18 14:49:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:49:36.209328 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-6ad5db6c-4011-4321-9963-4b6062c3e8ab admin admin] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:49:36.211895 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 14:49:36.211895 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: warnings.warn(msg) Aug 18 14:49:36.212998 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6ad5db6c-4011-4321-9963-4b6062c3e8ab admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:49:36.213495 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6ad5db6c-4011-4321-9963-4b6062c3e8ab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:49:36.213914 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6ad5db6c-4011-4321-9963-4b6062c3e8ab admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:49:36.214619 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6ad5db6c-4011-4321-9963-4b6062c3e8ab admin admin] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:49:36.215059 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6ad5db6c-4011-4321-9963-4b6062c3e8ab admin admin] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:49:36.215468 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6ad5db6c-4011-4321-9963-4b6062c3e8ab admin admin] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:49:36.239481 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-6ad5db6c-4011-4321-9963-4b6062c3e8ab admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082568 Aug 18 14:49:36.239977 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 38/76] 10.222.0.36 () {60 vars in 1193 bytes} [Thu Aug 18 14:49:36 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:50:34.833262 dv-cinder-852208-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 18 14:50:34.833863 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: Thu Aug 18 14:50:34 2022 - graceful shutdown triggered... Aug 18 14:50:34.834300 dv-cinder-852208-7-iscsi devstack@n-api.service[117153]: Gracefully killing worker 1 (pid: 117153)... Aug 18 14:50:34.834663 dv-cinder-852208-7-iscsi devstack@n-api.service[117154]: Gracefully killing worker 2 (pid: 117154)... Aug 18 14:50:35.834797 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: worker 1 buried after 1 seconds Aug 18 14:50:35.835655 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: worker 2 buried after 1 seconds Aug 18 14:50:35.835655 dv-cinder-852208-7-iscsi devstack@n-api.service[117152]: goodbye to uWSGI. Aug 18 14:50:35.836697 dv-cinder-852208-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 18 14:50:35.837246 dv-cinder-852208-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 18 14:50:35.840756 dv-cinder-852208-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 18 14:50:35.850283 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 18 14:50:35.852342 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 14:50:35 2022] *** Aug 18 14:50:35.852342 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 14:50:35.852342 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 14:50:35.852342 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: nodename: dv-cinder-852208-7-iscsi Aug 18 14:50:35.852342 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: machine: x86_64 Aug 18 14:50:35.852342 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: clock source: unix Aug 18 14:50:35.852342 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: pcre jit disabled Aug 18 14:50:35.852342 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: detected number of CPU cores: 4 Aug 18 14:50:35.852342 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: current working directory: / Aug 18 14:50:35.852342 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: detected binary path: /usr/bin/uwsgi-core Aug 18 14:50:35.852342 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: your processes number limit is 47680 Aug 18 14:50:35.852342 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: your memory page size is 4096 bytes Aug 18 14:50:35.852342 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: detected max file descriptor number: 2048 Aug 18 14:50:35.852342 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: lock engine: pthread robust mutexes Aug 18 14:50:35.853476 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: thunder lock: enabled Aug 18 14:50:35.853476 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 18 14:50:35.853476 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 14:50:35.893184 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: Python main interpreter initialized at 0x558785c089c0 Aug 18 14:50:35.893184 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: python threads support enabled Aug 18 14:50:35.893184 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: your server socket listen backlog is limited to 100 connections Aug 18 14:50:35.893184 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: your mercy for graceful operations on workers is 90 seconds Aug 18 14:50:35.893591 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 14:50:35.893679 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: *** Operational MODE: preforking *** Aug 18 14:50:35.893927 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: *** uWSGI is running in multiple interpreter mode *** Aug 18 14:50:35.893927 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: spawned uWSGI master process (pid: 132256) Aug 18 14:50:35.894173 dv-cinder-852208-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 18 14:50:35.895402 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: spawned uWSGI worker 1 (pid: 132267, cores: 1) Aug 18 14:50:35.895402 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: spawned uWSGI worker 2 (pid: 132268, cores: 1) Aug 18 14:50:35.895402 dv-cinder-852208-7-iscsi devstack@n-api.service[132256]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 14:50:36.574449 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 14:50:36.578006 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 14:50:37.743991 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 14:50:37.743991 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: from cryptography.utils import int_from_bytes Aug 18 14:50:37.744722 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 14:50:37.744722 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: from cryptography.utils import int_from_bytes Aug 18 14:50:37.758426 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 14:50:37.758426 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: from cryptography.utils import int_from_bytes Aug 18 14:50:37.759000 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 14:50:37.759000 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: from cryptography.utils import int_from_bytes Aug 18 14:50:40.158957 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 14:50:40.159539 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 14:50:40.159844 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 14:50:40.160162 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 14:50:40.160427 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 14:50:40.160830 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.161162 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.161492 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.161823 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.162170 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.162490 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.162829 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.163157 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.163496 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.163790 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.164122 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.164462 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-7-iscsi {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.164798 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.165297 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.165622 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.165955 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.166268 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.166600 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.166914 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.167441 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.170466 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.170987 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.171531 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.172122 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.172638 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.173154 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.173697 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.174189 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.174728 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.175235 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.175925 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-7-iscsi {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.176452 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.176966 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.177485 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.178185 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.178710 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.179222 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.179784 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.180337 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.180865 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.181394 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.181923 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.182448 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.182977 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.184062 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.184596 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.185110 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.185637 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.186142 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.186642 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.187054 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.187559 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.188142 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.188683 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.189204 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.189621 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.190033 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.190561 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.191092 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.191604 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.192141 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.192877 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.193227 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.193649 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.194148 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.194650 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.195157 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.195725 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.196241 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.196768 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.197276 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.197803 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.198482 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.198898 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.199453 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.200059 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.200584 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.201089 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.201612 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.202141 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.202645 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.203152 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.203658 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.204210 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.204751 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.205262 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.205673 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.206174 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.206675 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.207203 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.207716 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.208228 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.208735 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.209227 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.209732 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.210240 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.210739 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.211240 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.211794 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.212301 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.212813 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.213319 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.213825 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.214362 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.215436 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.215979 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.216486 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.216979 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.217482 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.218009 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.218514 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.219021 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.219551 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.220115 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.220614 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.221132 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.221636 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.222135 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.222657 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.223151 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.223649 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.224191 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.224695 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.225194 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.225696 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.226195 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.226695 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.227199 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.227723 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.228238 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.228742 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.229275 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.229809 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.230901 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.231425 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.231987 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.232496 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.233057 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.233602 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.234169 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.234686 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.235233 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.235803 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.236333 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.236849 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.237367 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.237899 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.238409 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.238928 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.239436 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.239990 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.240376 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 14:50:40.240822 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.240910 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 14:50:40.241088 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.241194 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 14:50:40.241535 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 14:50:40.241638 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.241805 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 14:50:40.242058 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.242185 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.242527 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.242630 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.242914 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.243084 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.243187 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.243494 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.243619 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.243832 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.244127 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.244230 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.244476 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.244650 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.244818 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.245617 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.245712 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.245795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.245795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-7-iscsi {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.246132 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.246208 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.246314 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.246548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.246829 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.246991 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.247148 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.247377 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.247565 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.247781 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.247934 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.248089 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.248442 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.248616 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.248917 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.249086 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.249245 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.249464 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.249623 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.249871 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.250037 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.250184 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.250497 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.250658 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.250827 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.251013 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.251167 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.251465 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.251650 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.251825 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.252099 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.252278 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-7-iscsi {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.252516 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.252675 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.252822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.253110 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.253273 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.253560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.253738 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.253894 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.254109 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.254289 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.254552 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.254719 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.254877 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.255124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.255277 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.255459 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.255998 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.256145 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.256389 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.256588 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.256749 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.256931 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.257101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.257320 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.257586 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.257766 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.257922 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.258104 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.258265 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.259237 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.259426 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.259576 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.259576 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.259906 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.260200 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.260300 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.260398 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.260398 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.260591 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.260694 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.260694 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.260852 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.260937 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.261125 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.261235 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.261517 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.261694 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.261824 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.262143 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.262276 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.262455 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.262723 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.262829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.263061 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.263272 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.263379 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.263669 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.263806 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.264015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.264308 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.264412 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.264651 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.264823 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.264961 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.265289 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.265378 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.265697 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.265828 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.265953 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.266264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.266358 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.266611 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.266835 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.266927 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.267234 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.267322 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.267558 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.267909 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.268026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.268221 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.268422 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.268520 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.268827 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.268924 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.269152 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.269442 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.269624 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.269787 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.269940 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.270047 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.270323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.270423 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.270632 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.270934 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.271026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.271257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.271444 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.271567 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.271904 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.272019 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.272212 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.272471 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.272573 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.272821 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.272982 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.273128 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.273439 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.273543 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.273748 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.274006 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.274119 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.274355 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.274514 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.274665 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.274975 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.275080 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.275297 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.275568 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.275661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.275948 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.276110 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.276258 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.276570 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.276716 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.276882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.277677 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.277804 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.278035 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.278214 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.278345 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.278673 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.278770 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.278983 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.279222 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.279344 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.279603 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.279766 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.279940 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.280252 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.280353 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.280575 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.280756 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.280879 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.281189 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.281287 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.281514 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.281752 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.281853 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.282124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.282252 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.282435 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.283284 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.283399 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.283399 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.283544 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.283841 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.283841 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.284000 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.284084 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.284234 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.284328 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.284565 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.284744 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.284891 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.285206 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.285309 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.285514 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.285719 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.285823 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.286147 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:50:40.286236 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.286490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.286764 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.286857 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.287163 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.287245 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.287482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.287828 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.287914 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.288177 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.288376 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.288502 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.288838 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.288941 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.289139 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.289415 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.289612 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.289784 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.289935 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.290096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.290412 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.290627 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.290770 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.290950 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.291131 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.291375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.291530 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.291708 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.291979 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.292243 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.292331 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.292492 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.292623 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.293560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.293727 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.293898 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.294116 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.294423 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.294580 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.294775 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.294935 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.295080 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.295332 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.295479 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.295645 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.295819 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.296137 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.296292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.296437 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.296663 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.296843 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.297059 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.297210 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.297389 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.297675 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.297827 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.298035 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.298237 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.298377 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.298663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.298807 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.298981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.299294 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.299439 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.299610 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.299863 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.299968 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.300287 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.300380 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.300607 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.300880 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.300974 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.301237 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.301388 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.301561 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.301880 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.301985 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.302195 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.302390 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.302495 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.302810 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.302914 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.303118 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.303409 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.303510 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.303753 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.303955 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.304069 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.304395 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.304499 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.304732 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.304970 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.305065 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.305378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.305499 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.305692 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.305997 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.306104 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.306351 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.306523 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.306670 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.306983 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.307087 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.307300 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.307524 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.307616 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.307945 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.308087 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.308277 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.308629 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.308730 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.308941 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.309160 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.309253 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.309565 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.309664 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.309877 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.310197 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.310289 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.310513 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.310705 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.310829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.311147 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.311252 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.311470 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.311732 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.311841 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.312133 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.312225 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.312451 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.312731 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.312851 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.313113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.313245 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.313424 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.313755 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.313852 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.314085 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.314263 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.314408 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.314719 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.314811 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.315036 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.315270 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.315372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.315649 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.315817 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.315971 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.316287 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.316380 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.316597 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.316809 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.316909 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.317203 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.317303 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.317513 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.317801 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.317907 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.318138 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.318327 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.318440 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.318750 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.318879 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.319339 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.319453 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.319653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.319899 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.320030 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.320345 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.320425 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.320696 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.320889 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.321043 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.321377 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.321457 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.321708 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.321908 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.323080 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.323080 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.323243 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.323329 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.323414 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.323497 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.323497 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.323662 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.323781 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.324854 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.324948 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.325041 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.325117 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.325197 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.325197 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.325348 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.325442 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.325442 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.325699 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.325795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.325983 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.326111 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.326369 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.326490 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.326720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.327018 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.327141 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.327370 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.327564 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.327712 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.328030 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.328143 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.328352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.328669 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.328766 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.328986 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.329236 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.329335 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.329604 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.329794 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.329928 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.330244 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.330342 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.330566 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.330826 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.330916 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.331202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.331300 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.331517 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.331841 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.331948 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.332176 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.332381 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.332552 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.332816 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.332956 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.333154 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.333388 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.333539 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.333772 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.333917 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.334104 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.334389 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.334551 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.334721 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.334901 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.335051 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.335339 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.335491 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.335646 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.335982 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.336303 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.336461 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.336605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.336894 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.337054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.337215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.337411 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.337556 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.337829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.337979 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.338131 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.338436 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.338587 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.338731 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.338955 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.339110 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.339365 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.339515 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.340236 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.340568 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.340707 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.340879 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.341144 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.341338 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.341497 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.341646 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.341808 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.342105 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.342256 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.342425 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.342628 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.342771 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.343042 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.343186 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.343426 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.343622 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.343802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.344172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.344262 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.344357 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.344604 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.344706 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.344924 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.345120 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.345242 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.345557 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.345657 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.345885 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.346154 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.346248 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.346507 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.346656 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.346819 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.347133 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.347226 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.347446 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.347636 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.347784 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.348115 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.348289 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.348430 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.348657 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.348766 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.349045 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.349171 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.349351 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.349665 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.349755 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.349987 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.350204 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.350569 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.350718 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.350904 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.351219 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.351317 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.352172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.352322 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.352402 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.352476 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.352547 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.352629 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.352821 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.352945 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.353248 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.353351 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.353561 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.353836 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.353937 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.354186 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.354384 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.354490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.354791 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.354922 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.355190 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.355990 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.356101 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.356285 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.356512 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.356787 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.356893 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.357051 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.357202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.357511 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.357627 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.357821 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.358086 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.358196 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.358435 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.358594 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.358758 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.359045 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.359140 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.359377 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.359556 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.360042 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.360204 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.360398 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.360588 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.360705 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.360954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.361097 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.361309 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.361603 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.361704 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.361961 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.362120 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.362299 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.362615 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.362708 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.362950 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.363119 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.363262 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.363590 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.363813 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.363930 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.364145 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.364238 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.364546 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.364667 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.364860 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.365314 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.365417 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.365505 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.365596 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.365777 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.366092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.366184 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.366409 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.366607 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.366715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.367026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.367141 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.367338 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.367596 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.367720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.367985 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.368130 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.368300 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.368611 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.368705 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.368936 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.369450 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.369556 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.369556 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.369718 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.369833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.370136 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.370238 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.370467 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.370652 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.370747 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.371072 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.371182 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.371416 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.371762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.371859 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.372019 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.372240 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.372341 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.372630 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.372755 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.372962 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.373261 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.373368 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.373576 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.373770 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.373888 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.374203 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.374303 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.374514 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.374764 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.374857 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.375125 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.375259 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.375456 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.375803 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.375955 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.376114 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.376335 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.376443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.376726 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.376850 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.377037 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.377347 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.377456 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.377658 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.377855 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.377966 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.378258 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.378361 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.378568 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.378840 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.378950 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.379172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.379345 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.379488 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.379823 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.379975 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.380121 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.380369 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.380727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.380996 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.381134 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.381347 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.381630 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.381724 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.382016 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.382110 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.382330 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.382618 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.382712 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.382966 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.383151 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.383283 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.383598 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.383720 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.383960 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.384177 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.384278 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.384581 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.384674 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.384899 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.385165 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.385265 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.385514 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.385733 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.385835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.386140 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.386233 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.386457 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.386795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.386888 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.387127 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.387329 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.387455 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.387813 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.387909 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.388126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.388382 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.388489 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.388745 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.388893 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.389060 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.389374 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.389525 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.389695 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.389914 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.390045 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.390317 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.390424 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.390636 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.390923 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.391023 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.391255 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.391432 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.391567 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.391911 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.392005 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.392234 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.392470 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.392577 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.392862 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.392962 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.393179 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.393493 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.393808 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.394124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.394443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.394540 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.394754 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.394993 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.395200 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.395516 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.395643 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.395929 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.396100 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.396193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.396472 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.396645 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.396830 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.397115 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.397330 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.397444 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.397737 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.397977 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.398166 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.399026 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.399142 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.399142 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.399336 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.399587 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.399728 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.399820 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.399820 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.399991 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.400084 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.400334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.400518 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.400644 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.400960 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.401058 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.401270 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.401541 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.401678 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.401904 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.402063 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.402765 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.403125 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.403226 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.403501 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.403636 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.403839 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.404171 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.404284 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.404573 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.404666 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.404892 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.405175 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.405275 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.405540 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.405677 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.405871 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.406183 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.406293 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.406503 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.406703 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.406820 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.407151 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.407250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.407486 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.407727 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.407828 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.408147 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.408240 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.408461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.408734 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.408837 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.409157 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.409256 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.409435 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.409768 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.409962 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.410190 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.410452 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.410560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.410827 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.410963 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.411159 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.411464 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.411554 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.411816 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.412004 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.412133 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.412452 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.412545 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.412765 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.413021 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.413121 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.413393 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.413540 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.413705 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.414020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.414120 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.414338 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.414656 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.414746 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.414968 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.415221 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.415325 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.415598 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.415968 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.416064 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.416446 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.416539 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.416753 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.416855 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.416951 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.417277 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.417452 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.417712 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.418365 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.418514 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.418762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.418987 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.419164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.419370 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.419530 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.419709 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.420058 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.420163 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.420373 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.420644 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.420754 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.421026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.421263 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.421368 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.421667 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.421760 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.422012 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.422336 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.422439 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.422664 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.422990 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.423096 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.423322 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.423637 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.423835 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.423976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.424343 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.424459 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.424594 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.424907 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.425011 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.425211 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.426160 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.426286 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.426286 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.426423 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.426496 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.426496 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.426635 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.426746 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.427056 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.427212 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.427387 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.428070 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.428220 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.428338 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.428338 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.428549 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.428662 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.428906 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.429065 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.429757 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.430234 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.430827 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.431401 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.431925 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.432043 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.432385 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.432519 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.432740 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.433099 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.433294 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.433703 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.433809 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.434046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.434291 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.434382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.434713 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.434880 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.435050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.435385 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.435634 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.436069 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.436267 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.436587 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.436838 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.437105 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.437419 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.437615 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.438006 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.438123 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.438545 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.438882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.439086 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.439471 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.439652 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.440087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.440405 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.440679 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.440782 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.441341 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.441458 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.441890 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.442028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.442435 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.442537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.442967 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.443070 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.443470 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.443572 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.444028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.444151 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.444494 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.444649 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.445092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.445228 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.445545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.445767 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.446164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.446350 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.446667 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.446925 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.447192 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.447501 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.447893 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.448134 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.448418 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.448646 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.448934 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.449269 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.449595 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.449825 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.450244 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.450376 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.450768 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.450927 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.451325 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.451483 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.451959 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.452182 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.452411 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.452850 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.453033 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.453357 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.453567 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.453981 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.454105 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.454504 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.454600 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.455012 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.455150 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.455523 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.455827 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.456077 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.456439 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.456595 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.457027 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.457135 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.457570 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.457664 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.458079 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.458376 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.458599 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.458752 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.459109 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.459422 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.459822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.459931 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.460481 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.460982 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.461092 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.461526 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.461647 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.462130 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.462262 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.462590 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.462687 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.463118 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.463214 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.463626 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.463791 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.464198 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.464363 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.465278 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.465473 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.465963 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.466497 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.466919 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.467085 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.467444 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.467641 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.467985 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.468256 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.468793 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.468907 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.469034 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.469349 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.469671 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.470000 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.470095 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.470615 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.470746 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.471168 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.471621 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.471791 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.472293 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.472412 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.472640 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.472736 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.473156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.473263 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.473684 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.473787 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.474179 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.474280 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.474661 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.474765 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.475149 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.475252 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.475644 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.475800 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.476152 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.476247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.476636 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.476752 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.477121 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.477225 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.477621 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.477720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.478115 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.478466 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.478705 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.478980 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.479135 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.479510 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.479951 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.480118 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.480409 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.481306 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.481538 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.481782 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.482066 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.482315 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.482577 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.482769 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.483095 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.483280 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.483606 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.483819 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.484139 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.484331 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.484778 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.484882 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.485273 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.485370 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.485767 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.485898 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.486279 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.486448 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.486795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.486973 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.487297 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.487490 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.487830 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.488033 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.488336 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.488549 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.488848 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.489132 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.489363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.489649 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.489924 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.490203 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.490431 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.490650 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.491607 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.491737 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.491850 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.491947 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.492035 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.492190 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.492669 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.492789 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.493060 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.493195 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.493686 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.493797 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.494190 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.494292 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.494696 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.494878 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.495209 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.495429 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.495745 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.496015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.496319 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.496886 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.497003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.497393 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.497496 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.497893 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.497996 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.498381 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.498476 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.498971 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.499077 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.499424 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.499868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.500036 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.500378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.500571 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.500902 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.501179 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.501411 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.501817 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.501976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.502121 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.502391 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.502574 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.503181 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.503339 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.503488 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.503649 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.503873 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.503873 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.504125 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.504223 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.504373 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.504668 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.504790 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.505017 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.505264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.505358 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.505910 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.506127 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.506232 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.506547 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.506703 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.507122 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.507233 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.507478 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.507790 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.507905 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.508157 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.508346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.508491 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.508818 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.508910 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.509141 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.509412 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.509514 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.509778 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.510034 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.510134 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.510492 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.510604 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.510724 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.511038 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.511215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.511358 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.511985 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.512110 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.512199 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.512333 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.512435 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.512666 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.512924 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.513051 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.513364 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.513463 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.513596 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.513907 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.514070 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.514216 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.514533 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.514634 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.514846 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.515144 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.515236 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.515458 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.515773 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.515947 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.516092 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.516380 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.516525 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.516681 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.516966 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.517143 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.517284 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.517587 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.517765 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.517912 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.518179 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.518350 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.518497 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.518815 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.519018 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.519198 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.519497 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.519660 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.519876 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.520132 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.520353 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.520726 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.520880 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.521020 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.521229 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.521370 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.521554 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.521826 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.522240 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.522394 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.522541 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.522801 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.522968 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.523254 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.523740 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.523903 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.524063 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.524211 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.524211 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.524521 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.524733 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.525020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.525189 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.525347 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.525555 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.525714 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.525958 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.526143 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.526287 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.526573 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.526791 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.526939 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.527821 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.528064 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.528380 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.528691 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.528796 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.529067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.529345 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.529596 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.529867 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.529983 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.530375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.530483 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.531131 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.531246 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.531416 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.531522 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.531893 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.531990 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.532356 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.532477 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.532673 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.532977 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.533071 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.533500 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.533834 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.533941 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.534068 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.534401 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.534573 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.534853 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.535128 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.535325 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.535568 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.535783 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.536087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.536180 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.536585 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.536684 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.537082 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.537188 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.537575 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.537674 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.538057 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.538170 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.538498 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.538597 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.538965 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.539090 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.539359 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.539606 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.539865 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.540029 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.540213 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.540352 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.540712 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.540852 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.541071 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.541528 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.541666 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.541817 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.541916 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.542002 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.542380 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.542504 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.542599 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.543563 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.543729 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.543835 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.544149 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.544451 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.544767 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.545085 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.545401 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.546281 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.546281 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.546482 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.546625 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.546832 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.546940 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.547231 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.547466 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.547557 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.547861 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.548099 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.548205 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.548470 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.548722 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.548813 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.549082 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.549329 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.549422 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.549684 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.549961 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.550073 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.550292 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.550512 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.550669 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.550967 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.551131 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.551293 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.551623 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.551744 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.551969 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.552249 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.552342 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.552619 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.552986 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.553105 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.553246 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.553438 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.553567 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.553884 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.553997 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.554310 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.554528 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.554621 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.554847 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.555128 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.555234 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.555519 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.555751 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.555849 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.556109 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.556331 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.556440 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.556765 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.556943 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.557078 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.557412 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.557516 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.557735 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.558035 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.558149 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.558422 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.558667 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.558777 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.559043 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.559268 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.559361 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.559788 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.559937 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.560130 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.560309 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.560531 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.560625 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.560914 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.561121 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.561221 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.561536 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.561786 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.562158 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.562338 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.562512 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.562512 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.562939 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.563166 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.563307 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.563457 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.563457 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.563781 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.564010 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.564163 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.564479 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.564479 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.564773 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.564913 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.565051 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.565200 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.565379 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.565528 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.565759 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.565993 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.566137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.566287 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 14:50:40.566501 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.566908 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.567315 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.567775 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.568167 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.568592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.568997 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.569389 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.570198 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.570198 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:50:40.570408 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 14:50:40.628743 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO dbcounter [None req-24f2b53c-39f2-44be-9b70-4a17212be30a None None] Registered counter for database nova_api Aug 18 14:50:40.632929 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO dbcounter [None req-96347364-1edb-47e1-8eb8-a95792ad6978 None None] Registered counter for database nova_api Aug 18 14:50:40.650745 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_db.sqlalchemy.engines [None req-24f2b53c-39f2-44be-9b70-4a17212be30a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:50:40.654849 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_db.sqlalchemy.engines [None req-96347364-1edb-47e1-8eb8-a95792ad6978 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:50:40.658237 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writer thread running {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:50:40.661473 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writer thread running {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:50:40.716159 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.context [None req-24f2b53c-39f2-44be-9b70-4a17212be30a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b3f44a74-f470-4dbc-81de-0c86ad3f4d2c(cell1) {{(pid=132267) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 14:50:40.719271 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.context [None req-96347364-1edb-47e1-8eb8-a95792ad6978 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b3f44a74-f470-4dbc-81de-0c86ad3f4d2c(cell1) {{(pid=132268) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 14:50:40.720259 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-24f2b53c-39f2-44be-9b70-4a17212be30a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:50:40.720741 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-24f2b53c-39f2-44be-9b70-4a17212be30a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:50:40.722324 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-24f2b53c-39f2-44be-9b70-4a17212be30a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:50:40.723069 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-24f2b53c-39f2-44be-9b70-4a17212be30a None None] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:50:40.723310 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-96347364-1edb-47e1-8eb8-a95792ad6978 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:50:40.723520 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-24f2b53c-39f2-44be-9b70-4a17212be30a None None] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:50:40.723807 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-96347364-1edb-47e1-8eb8-a95792ad6978 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:50:40.725361 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-96347364-1edb-47e1-8eb8-a95792ad6978 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:50:40.725562 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-24f2b53c-39f2-44be-9b70-4a17212be30a None None] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:50:40.726093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-96347364-1edb-47e1-8eb8-a95792ad6978 None None] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:50:40.726542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-96347364-1edb-47e1-8eb8-a95792ad6978 None None] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:50:40.727563 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO dbcounter [None req-24f2b53c-39f2-44be-9b70-4a17212be30a None None] Registered counter for database nova_cell0 Aug 18 14:50:40.728574 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-96347364-1edb-47e1-8eb8-a95792ad6978 None None] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:50:40.730622 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO dbcounter [None req-96347364-1edb-47e1-8eb8-a95792ad6978 None None] Registered counter for database nova_cell0 Aug 18 14:50:40.731724 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO dbcounter [None req-24f2b53c-39f2-44be-9b70-4a17212be30a None None] Registered counter for database nova_cell1 Aug 18 14:50:40.734645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO dbcounter [None req-96347364-1edb-47e1-8eb8-a95792ad6978 None None] Registered counter for database nova_cell1 Aug 18 14:50:40.739432 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_db.sqlalchemy.engines [None req-24f2b53c-39f2-44be-9b70-4a17212be30a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:50:40.741414 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_db.sqlalchemy.engines [None req-24f2b53c-39f2-44be-9b70-4a17212be30a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:50:40.743469 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_db.sqlalchemy.engines [None req-96347364-1edb-47e1-8eb8-a95792ad6978 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:50:40.744776 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_db.sqlalchemy.engines [None req-96347364-1edb-47e1-8eb8-a95792ad6978 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:50:40.748586 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writer thread running {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:50:40.749872 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writer thread running {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:50:40.752155 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writer thread running {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:50:40.753502 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writer thread running {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:50:40.899876 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO dbcounter [None req-24f2b53c-39f2-44be-9b70-4a17212be30a None None] Registered counter for database nova_cell0 Aug 18 14:50:40.907155 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_db.sqlalchemy.engines [None req-24f2b53c-39f2-44be-9b70-4a17212be30a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:50:40.912002 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writer thread running {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:50:40.914165 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO dbcounter [None req-96347364-1edb-47e1-8eb8-a95792ad6978 None None] Registered counter for database nova_cell0 Aug 18 14:50:40.921713 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_db.sqlalchemy.engines [None req-96347364-1edb-47e1-8eb8-a95792ad6978 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:50:40.926499 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writer thread running {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:50:41.232150 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: WARNING keystonemiddleware.auth_token [None req-24f2b53c-39f2-44be-9b70-4a17212be30a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 14:50:41.239521 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: WARNING keystonemiddleware.auth_token [None req-24f2b53c-39f2-44be-9b70-4a17212be30a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 14:50:41.251021 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: WARNING keystonemiddleware.auth_token [None req-96347364-1edb-47e1-8eb8-a95792ad6978 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 14:50:41.258711 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: WARNING keystonemiddleware.auth_token [None req-96347364-1edb-47e1-8eb8-a95792ad6978 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 14:50:41.590914 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: WARNING keystonemiddleware.auth_token [None req-24f2b53c-39f2-44be-9b70-4a17212be30a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 14:50:41.597982 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: WARNING keystonemiddleware.auth_token [None req-24f2b53c-39f2-44be-9b70-4a17212be30a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 14:50:41.603575 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558785c089c0 pid: 132267 (default app) Aug 18 14:50:41.612290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: WARNING keystonemiddleware.auth_token [None req-96347364-1edb-47e1-8eb8-a95792ad6978 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 14:50:41.618637 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: WARNING keystonemiddleware.auth_token [None req-96347364-1edb-47e1-8eb8-a95792ad6978 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 14:50:41.624271 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558785c089c0 pid: 132268 (default app) Aug 18 14:51:18.064693 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_api:SELECT=3 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:51:18.067417 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_cell0:SELECT=3 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:51:18.070593 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_cell1:SELECT=3 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:51:18.071435 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_cell0:SELECT=3 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:51:18.238238 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=3 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:51:18.239062 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=3 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:51:18.242381 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=3 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:51:18.243146 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=3 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:51:19.201234 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-4b68d5fd-b21b-4841-9b68-303258bc7821 tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] Action: 'create', calling method: .version_select at 0x7fb2151a54c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-392286682", "metadata": {"Type": "work"}}} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:51:19.213634 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-4b68d5fd-b21b-4841-9b68-303258bc7821 tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] Request method failure captured: Aug 18 14:51:19.213634 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 18 14:51:19.213634 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept: application/json Aug 18 14:51:19.213634 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept-Encoding: identity Aug 18 14:51:19.213634 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Connection: close Aug 18 14:51:19.213634 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Length: 121 Aug 18 14:51:19.213634 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Type: application/json Aug 18 14:51:19.213634 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Host: 10.222.0.36 Aug 18 14:51:19.213634 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Openstack-System-Scope: None Aug 18 14:51:19.213634 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: User-Agent: python-urllib3/1.26.11 Aug 18 14:51:19.213634 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Auth-Token: gAAAAABi_lHl7sxQiNT17m1-bYqvPa1VzgCY8BEe5COX1ZkGUNIECTBZtzTgmtDvxCfKfM92BHC2oArCSQ6L8w4OmBU8H0QFMaPdNgq3j1-Jn1KDblluKc_OTgCsFcX90yyMOVux2v_64MuB9Jv1_VfaO27TJhKKZ-4K7daWA-cZL0D5C7XJ_wE Aug 18 14:51:19.213634 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Id: None Aug 18 14:51:19.213634 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Name: None Aug 18 14:51:19.213634 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Identity-Status: Confirmed Aug 18 14:51:19.213634 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Is-Admin-Project: True Aug 18 14:51:19.213634 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Id: default Aug 18 14:51:19.213634 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Name: Default Aug 18 14:51:19.213634 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Id: 7e523324eb6745e0a8b6f2c147c91312 Aug 18 14:51:19.213634 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Name: tempest-VolumesNegativeTest-629935173 Aug 18 14:51:19.213634 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Role: reader,member Aug 18 14:51:19.213634 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Roles: reader,member Aug 18 14:51:19.215657 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7e523324eb6745e0a8b6f2c147c91312"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7e523324eb6745e0a8b6f2c147c91312"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7e523324eb6745e0a8b6f2c147c91312", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7e523324eb6745e0a8b6f2c147c91312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:51:19.215657 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant: tempest-VolumesNegativeTest-629935173 Aug 18 14:51:19.215657 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Id: 7e523324eb6745e0a8b6f2c147c91312 Aug 18 14:51:19.215657 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Name: tempest-VolumesNegativeTest-629935173 Aug 18 14:51:19.215657 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User: tempest-VolumesNegativeTest-629935173-project Aug 18 14:51:19.215657 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Id: default Aug 18 14:51:19.215657 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Name: Default Aug 18 14:51:19.215657 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Id: 5f0c269f8bfd426b9eb18e011168040b Aug 18 14:51:19.215657 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Name: tempest-VolumesNegativeTest-629935173-project Aug 18 14:51:19.215657 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Aug 18 14:51:19.215657 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-392286682", "metadata": {"Type": "work"}}} Aug 18 14:51:19.215657 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: method: Aug 18 14:51:19.215657 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 18 14:51:19.216573 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-392286682', 'metadata': {'Type': 'work'}}}} Aug 18 14:51:19.216573 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:51:19.216573 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:19.216573 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 14:51:19.216573 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 14:51:19.216573 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 14:51:19.216573 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise error Aug 18 14:51:19.216573 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 18 14:51:19.216573 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.216573 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 18 14:51:19.216573 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 18 14:51:19.216573 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.216573 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 18 14:51:19.216573 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi '#$%' Aug 18 14:51:19.216573 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.216573 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:51:19.216573 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.216573 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:19.216573 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:51:19.216573 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:51:19.216573 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:51:19.216573 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:51:19.217953 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 14:51:19.217953 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 14:51:19.217953 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:51:19.217953 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:51:19.217953 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 14:51:19.217953 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 14:51:19.217953 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 14:51:19.217953 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 14:51:19.217953 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 14:51:19.217953 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 14:51:19.217953 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 18 14:51:19.217953 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.217953 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:51:19.217953 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.217953 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:19.217953 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:51:19.217953 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:51:19.217953 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 14:51:19.217953 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 14:51:19.219095 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 18 14:51:19.219095 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.226590 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-4b68d5fd-b21b-4841-9b68-303258bc7821 tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=132267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:51:19.228073 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-4b68d5fd-b21b-4841-9b68-303258bc7821 tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.183134 Aug 18 14:51:19.232747 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 1/1] 10.222.0.36 () {60 vars in 1156 bytes} [Thu Aug 18 14:51:18 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1189 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 14:51:19.242338 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-52867236-c3ef-4147-bc19-653952091602 tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] Action: 'create', calling method: .version_select at 0x7fb2151a5550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1004097975", "metadata": {"Type": "work"}}} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:51:19.249825 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-52867236-c3ef-4147-bc19-653952091602 tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] Request method failure captured: Aug 18 14:51:19.249825 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 18 14:51:19.249825 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept: application/json Aug 18 14:51:19.249825 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept-Encoding: identity Aug 18 14:51:19.249825 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Connection: close Aug 18 14:51:19.249825 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Length: 120 Aug 18 14:51:19.249825 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Type: application/json Aug 18 14:51:19.249825 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Host: 10.222.0.36 Aug 18 14:51:19.249825 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Openstack-System-Scope: None Aug 18 14:51:19.249825 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: User-Agent: python-urllib3/1.26.11 Aug 18 14:51:19.249825 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Auth-Token: gAAAAABi_lHl7sxQiNT17m1-bYqvPa1VzgCY8BEe5COX1ZkGUNIECTBZtzTgmtDvxCfKfM92BHC2oArCSQ6L8w4OmBU8H0QFMaPdNgq3j1-Jn1KDblluKc_OTgCsFcX90yyMOVux2v_64MuB9Jv1_VfaO27TJhKKZ-4K7daWA-cZL0D5C7XJ_wE Aug 18 14:51:19.249825 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Id: None Aug 18 14:51:19.249825 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Name: None Aug 18 14:51:19.249825 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Identity-Status: Confirmed Aug 18 14:51:19.249825 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Is-Admin-Project: True Aug 18 14:51:19.249825 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Id: default Aug 18 14:51:19.249825 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Name: Default Aug 18 14:51:19.249825 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Id: 7e523324eb6745e0a8b6f2c147c91312 Aug 18 14:51:19.249825 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Name: tempest-VolumesNegativeTest-629935173 Aug 18 14:51:19.249825 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Role: reader,member Aug 18 14:51:19.249825 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Roles: reader,member Aug 18 14:51:19.251245 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7e523324eb6745e0a8b6f2c147c91312"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7e523324eb6745e0a8b6f2c147c91312"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7e523324eb6745e0a8b6f2c147c91312", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7e523324eb6745e0a8b6f2c147c91312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:51:19.251245 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant: tempest-VolumesNegativeTest-629935173 Aug 18 14:51:19.251245 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Id: 7e523324eb6745e0a8b6f2c147c91312 Aug 18 14:51:19.251245 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Name: tempest-VolumesNegativeTest-629935173 Aug 18 14:51:19.251245 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User: tempest-VolumesNegativeTest-629935173-project Aug 18 14:51:19.251245 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Id: default Aug 18 14:51:19.251245 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Name: Default Aug 18 14:51:19.251245 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Id: 5f0c269f8bfd426b9eb18e011168040b Aug 18 14:51:19.251245 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Name: tempest-VolumesNegativeTest-629935173-project Aug 18 14:51:19.251245 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Aug 18 14:51:19.251245 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1004097975", "metadata": {"Type": "work"}}} Aug 18 14:51:19.251245 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: method: Aug 18 14:51:19.251245 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 18 14:51:19.252063 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1004097975', 'metadata': {'Type': 'work'}}}} Aug 18 14:51:19.252063 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:51:19.252063 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:19.252063 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 14:51:19.252063 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 14:51:19.252063 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 14:51:19.252063 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise error Aug 18 14:51:19.252063 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 18 14:51:19.252063 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.252063 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 18 14:51:19.252063 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 18 14:51:19.252063 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.252063 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 18 14:51:19.252063 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi '0' Aug 18 14:51:19.252063 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.252063 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:51:19.252063 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.252063 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:19.252063 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:51:19.252063 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:51:19.252063 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:51:19.252063 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:51:19.253360 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 14:51:19.253360 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 14:51:19.253360 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:51:19.253360 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:51:19.253360 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 14:51:19.253360 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 14:51:19.253360 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 14:51:19.253360 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 14:51:19.253360 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 14:51:19.253360 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 14:51:19.253360 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 18 14:51:19.253360 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.253360 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:51:19.253360 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.253360 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:19.253360 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:51:19.253360 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:51:19.253360 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 14:51:19.253360 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 14:51:19.254423 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 18 14:51:19.254423 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.264568 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-52867236-c3ef-4147-bc19-653952091602 tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=132267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:51:19.265774 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-52867236-c3ef-4147-bc19-653952091602 tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.027420 Aug 18 14:51:19.266862 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 2/2] 10.222.0.36 () {60 vars in 1156 bytes} [Thu Aug 18 14:51:19 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 18 14:51:19.284410 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-885394a4-e629-4eac-b279-24b36539115d tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] Action: 'create', calling method: .version_select at 0x7fb2150e20d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-78601686", "metadata": {"Type": "work"}}} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:51:19.288550 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-885394a4-e629-4eac-b279-24b36539115d tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] Request method failure captured: Aug 18 14:51:19.288550 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 18 14:51:19.288550 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept: application/json Aug 18 14:51:19.288550 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept-Encoding: identity Aug 18 14:51:19.288550 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Connection: close Aug 18 14:51:19.288550 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Length: 117 Aug 18 14:51:19.288550 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Type: application/json Aug 18 14:51:19.288550 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Host: 10.222.0.36 Aug 18 14:51:19.288550 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Openstack-System-Scope: None Aug 18 14:51:19.288550 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: User-Agent: python-urllib3/1.26.11 Aug 18 14:51:19.288550 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Auth-Token: gAAAAABi_lHl7sxQiNT17m1-bYqvPa1VzgCY8BEe5COX1ZkGUNIECTBZtzTgmtDvxCfKfM92BHC2oArCSQ6L8w4OmBU8H0QFMaPdNgq3j1-Jn1KDblluKc_OTgCsFcX90yyMOVux2v_64MuB9Jv1_VfaO27TJhKKZ-4K7daWA-cZL0D5C7XJ_wE Aug 18 14:51:19.288550 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Id: None Aug 18 14:51:19.288550 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Name: None Aug 18 14:51:19.288550 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Identity-Status: Confirmed Aug 18 14:51:19.288550 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Is-Admin-Project: True Aug 18 14:51:19.288550 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Id: default Aug 18 14:51:19.288550 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Name: Default Aug 18 14:51:19.288550 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Id: 7e523324eb6745e0a8b6f2c147c91312 Aug 18 14:51:19.288550 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Name: tempest-VolumesNegativeTest-629935173 Aug 18 14:51:19.288550 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Role: reader,member Aug 18 14:51:19.288550 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Roles: reader,member Aug 18 14:51:19.289844 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7e523324eb6745e0a8b6f2c147c91312"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7e523324eb6745e0a8b6f2c147c91312"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7e523324eb6745e0a8b6f2c147c91312", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7e523324eb6745e0a8b6f2c147c91312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:51:19.289844 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant: tempest-VolumesNegativeTest-629935173 Aug 18 14:51:19.289844 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Id: 7e523324eb6745e0a8b6f2c147c91312 Aug 18 14:51:19.289844 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Name: tempest-VolumesNegativeTest-629935173 Aug 18 14:51:19.289844 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User: tempest-VolumesNegativeTest-629935173-project Aug 18 14:51:19.289844 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Id: default Aug 18 14:51:19.289844 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Name: Default Aug 18 14:51:19.289844 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Id: 5f0c269f8bfd426b9eb18e011168040b Aug 18 14:51:19.289844 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Name: tempest-VolumesNegativeTest-629935173-project Aug 18 14:51:19.289844 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Aug 18 14:51:19.289844 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-78601686", "metadata": {"Type": "work"}}} Aug 18 14:51:19.289844 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: method: Aug 18 14:51:19.289844 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 18 14:51:19.290606 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-78601686', 'metadata': {'Type': 'work'}}}} Aug 18 14:51:19.290606 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:51:19.290606 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:19.290606 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 14:51:19.290606 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 14:51:19.290606 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 14:51:19.290606 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise error Aug 18 14:51:19.290606 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 18 14:51:19.290606 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.290606 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 18 14:51:19.290606 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 18 14:51:19.290606 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.290606 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 18 14:51:19.290606 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi '' Aug 18 14:51:19.290606 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.290606 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:51:19.290606 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.290606 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:19.290606 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:51:19.290606 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:51:19.290606 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:51:19.290606 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:51:19.292481 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 14:51:19.292481 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 14:51:19.292481 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:51:19.292481 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:51:19.292481 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 14:51:19.292481 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 14:51:19.292481 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 14:51:19.292481 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 14:51:19.292481 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 14:51:19.292481 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 14:51:19.292481 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 18 14:51:19.292481 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.292481 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:51:19.292481 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.292481 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:19.292481 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:51:19.292481 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:51:19.292481 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 14:51:19.292481 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 14:51:19.293541 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 18 14:51:19.293541 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.303791 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-885394a4-e629-4eac-b279-24b36539115d tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=132267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:51:19.304874 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-885394a4-e629-4eac-b279-24b36539115d tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024850 Aug 18 14:51:19.305943 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 3/3] 10.222.0.36 () {60 vars in 1156 bytes} [Thu Aug 18 14:51:19 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 18 14:51:19.315382 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-c63cce50-8386-47dc-b1d4-22f4679060b6 tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] Calling method '.version_select at 0x7fb2150e2a60>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:19.358741 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-60aeb75a-4e89-436a-9c56-8b9f690bfde8 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] Action: 'create', calling method: .version_select at 0x7fb2152244c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-453029004"}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:51:19.977523 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.wsgi [None req-c63cce50-8386-47dc-b1d4-22f4679060b6 tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] HTTP exception thrown: Volume tempest-invalid-1732367319 could not be found. Aug 18 14:51:19.981727 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-c63cce50-8386-47dc-b1d4-22f4679060b6 tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] Request method failure captured: Aug 18 14:51:19.981727 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1732367319 HTTP/1.1 Aug 18 14:51:19.981727 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept: application/json Aug 18 14:51:19.981727 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept-Encoding: identity Aug 18 14:51:19.981727 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Connection: close Aug 18 14:51:19.981727 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Length: 0 Aug 18 14:51:19.981727 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Type: application/json Aug 18 14:51:19.981727 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Host: 10.222.0.36 Aug 18 14:51:19.981727 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Openstack-System-Scope: None Aug 18 14:51:19.981727 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: User-Agent: python-urllib3/1.26.11 Aug 18 14:51:19.981727 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Auth-Token: gAAAAABi_lHl7sxQiNT17m1-bYqvPa1VzgCY8BEe5COX1ZkGUNIECTBZtzTgmtDvxCfKfM92BHC2oArCSQ6L8w4OmBU8H0QFMaPdNgq3j1-Jn1KDblluKc_OTgCsFcX90yyMOVux2v_64MuB9Jv1_VfaO27TJhKKZ-4K7daWA-cZL0D5C7XJ_wE Aug 18 14:51:19.981727 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Id: None Aug 18 14:51:19.981727 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Name: None Aug 18 14:51:19.981727 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Identity-Status: Confirmed Aug 18 14:51:19.981727 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Is-Admin-Project: True Aug 18 14:51:19.981727 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Id: default Aug 18 14:51:19.981727 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Name: Default Aug 18 14:51:19.981727 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Id: 7e523324eb6745e0a8b6f2c147c91312 Aug 18 14:51:19.981727 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Name: tempest-VolumesNegativeTest-629935173 Aug 18 14:51:19.981727 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Role: reader,member Aug 18 14:51:19.981727 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Roles: reader,member Aug 18 14:51:19.983067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7e523324eb6745e0a8b6f2c147c91312"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7e523324eb6745e0a8b6f2c147c91312"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7e523324eb6745e0a8b6f2c147c91312", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7e523324eb6745e0a8b6f2c147c91312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:51:19.983067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant: tempest-VolumesNegativeTest-629935173 Aug 18 14:51:19.983067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Id: 7e523324eb6745e0a8b6f2c147c91312 Aug 18 14:51:19.983067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Name: tempest-VolumesNegativeTest-629935173 Aug 18 14:51:19.983067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User: tempest-VolumesNegativeTest-629935173-project Aug 18 14:51:19.983067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Id: default Aug 18 14:51:19.983067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Name: Default Aug 18 14:51:19.983067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Id: 5f0c269f8bfd426b9eb18e011168040b Aug 18 14:51:19.983067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Name: tempest-VolumesNegativeTest-629935173-project Aug 18 14:51:19.983067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: method: Aug 18 14:51:19.983067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: exception: Volume tempest-invalid-1732367319 could not be found. Aug 18 14:51:19.983067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: action_args: {'id': 'tempest-invalid-1732367319'} Aug 18 14:51:19.983067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:51:19.984092 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:19.984092 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:51:19.984092 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:51:19.984092 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 14:51:19.984092 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 14:51:19.984092 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 14:51:19.984092 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 14:51:19.984092 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 14:51:19.984092 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 14:51:19.984092 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 14:51:19.984092 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 14:51:19.984092 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:51:19.984092 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:51:19.984092 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:51:19.984092 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:51:19.984092 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1732367319 could not be found. (HTTP 404) (Request-ID: req-86433d16-84cc-465f-a39f-b164662ac7f2) Aug 18 14:51:19.984092 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.984092 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:51:19.984092 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.985254 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:19.985254 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 18 14:51:19.985254 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 18 14:51:19.985254 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 14:51:19.985254 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 14:51:19.985254 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 14:51:19.985254 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 14:51:19.985254 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 14:51:19.985254 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 14:51:19.985254 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:51:19.985254 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:51:19.985254 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 14:51:19.985254 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 14:51:19.985254 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 14:51:19.985254 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 14:51:19.985254 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 14:51:19.985254 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 14:51:19.985254 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 14:51:19.985254 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 14:51:19.986414 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:51:19.986414 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:51:19.986414 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:51:19.986414 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:51:19.986414 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1732367319 could not be found. Aug 18 14:51:19.986414 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.986414 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:51:19.986414 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.986414 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:19.986414 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:51:19.986414 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:51:19.986414 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:51:19.986414 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:51:19.986414 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 14:51:19.986414 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 14:51:19.986414 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:51:19.986414 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:51:19.986414 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 18 14:51:19.986414 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:51:19.986414 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1732367319 could not be found. Aug 18 14:51:19.987662 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.987662 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:51:19.987662 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.987662 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:19.987662 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:51:19.987662 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:51:19.987662 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:51:19.987662 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:51:19.987662 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1732367319 could not be found. Aug 18 14:51:19.987662 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:19.991567 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-c63cce50-8386-47dc-b1d4-22f4679060b6 tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] Returning 404 to user: Volume tempest-invalid-1732367319 could not be found. {{(pid=132267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:51:19.992850 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-c63cce50-8386-47dc-b1d4-22f4679060b6 tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1732367319" status: 404 len: 99 microversion: 2.1 time: 0.681648 Aug 18 14:51:19.993924 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 4/4] 10.222.0.36 () {58 vars in 1218 bytes} [Thu Aug 18 14:51:19 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1732367319 => generated 99 bytes in 683 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 18 14:51:20.007798 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-eca298b3-30ba-420f-b6ae-c0bb7988feaa tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004024 Aug 18 14:51:20.009279 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 5/5] 10.222.0.36 () {58 vars in 1140 bytes} [Thu Aug 18 14:51:19 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 18 14:51:20.020868 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-31c9f5ae-fd39-4467-a2d3-747255007429 tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006144 Aug 18 14:51:20.023059 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 6/6] 10.222.0.36 () {58 vars in 1137 bytes} [Thu Aug 18 14:51:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 18 14:51:20.032159 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-001c6c16-bd24-42db-9a05-12642706f380 tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] Calling method '.version_select at 0x7fb2150143a0>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:20.144641 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.wsgi [None req-001c6c16-bd24-42db-9a05-12642706f380 tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] HTTP exception thrown: Volume b4731bf2-0400-41e4-b0b8-3e6b5155f81f could not be found. Aug 18 14:51:20.153067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-001c6c16-bd24-42db-9a05-12642706f380 tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] Request method failure captured: Aug 18 14:51:20.153067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: request: DELETE /compute/v2.1/os-volumes/b4731bf2-0400-41e4-b0b8-3e6b5155f81f HTTP/1.1 Aug 18 14:51:20.153067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept: application/json Aug 18 14:51:20.153067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept-Encoding: identity Aug 18 14:51:20.153067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Connection: close Aug 18 14:51:20.153067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Length: 0 Aug 18 14:51:20.153067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Type: application/json Aug 18 14:51:20.153067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Host: 10.222.0.36 Aug 18 14:51:20.153067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Openstack-System-Scope: None Aug 18 14:51:20.153067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: User-Agent: python-urllib3/1.26.11 Aug 18 14:51:20.153067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Auth-Token: gAAAAABi_lHl7sxQiNT17m1-bYqvPa1VzgCY8BEe5COX1ZkGUNIECTBZtzTgmtDvxCfKfM92BHC2oArCSQ6L8w4OmBU8H0QFMaPdNgq3j1-Jn1KDblluKc_OTgCsFcX90yyMOVux2v_64MuB9Jv1_VfaO27TJhKKZ-4K7daWA-cZL0D5C7XJ_wE Aug 18 14:51:20.153067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Id: None Aug 18 14:51:20.153067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Name: None Aug 18 14:51:20.153067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Identity-Status: Confirmed Aug 18 14:51:20.153067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Is-Admin-Project: True Aug 18 14:51:20.153067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Id: default Aug 18 14:51:20.153067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Name: Default Aug 18 14:51:20.153067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Id: 7e523324eb6745e0a8b6f2c147c91312 Aug 18 14:51:20.153067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Name: tempest-VolumesNegativeTest-629935173 Aug 18 14:51:20.153067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Role: reader,member Aug 18 14:51:20.153067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Roles: reader,member Aug 18 14:51:20.155174 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7e523324eb6745e0a8b6f2c147c91312"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7e523324eb6745e0a8b6f2c147c91312"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7e523324eb6745e0a8b6f2c147c91312", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7e523324eb6745e0a8b6f2c147c91312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:51:20.155174 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant: tempest-VolumesNegativeTest-629935173 Aug 18 14:51:20.155174 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Id: 7e523324eb6745e0a8b6f2c147c91312 Aug 18 14:51:20.155174 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Name: tempest-VolumesNegativeTest-629935173 Aug 18 14:51:20.155174 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User: tempest-VolumesNegativeTest-629935173-project Aug 18 14:51:20.155174 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Id: default Aug 18 14:51:20.155174 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Name: Default Aug 18 14:51:20.155174 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Id: 5f0c269f8bfd426b9eb18e011168040b Aug 18 14:51:20.155174 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Name: tempest-VolumesNegativeTest-629935173-project Aug 18 14:51:20.155174 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: method: Aug 18 14:51:20.155174 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: exception: Volume b4731bf2-0400-41e4-b0b8-3e6b5155f81f could not be found. Aug 18 14:51:20.155174 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: action_args: {'id': 'b4731bf2-0400-41e4-b0b8-3e6b5155f81f'} Aug 18 14:51:20.155174 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:51:20.156463 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:20.156463 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:51:20.156463 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:51:20.156463 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 14:51:20.156463 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 14:51:20.156463 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 14:51:20.156463 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 14:51:20.156463 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 14:51:20.156463 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 14:51:20.156463 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 14:51:20.156463 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 14:51:20.156463 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:51:20.156463 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:51:20.156463 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:51:20.156463 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:51:20.156463 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b4731bf2-0400-41e4-b0b8-3e6b5155f81f could not be found. (HTTP 404) (Request-ID: req-6941ca0f-e4e1-4f9f-b724-4e1efbee4980) Aug 18 14:51:20.156463 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:20.156463 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:51:20.156463 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:20.164484 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:20.164484 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 18 14:51:20.164484 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 18 14:51:20.164484 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 14:51:20.164484 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 14:51:20.164484 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 14:51:20.164484 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 14:51:20.164484 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 14:51:20.164484 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 14:51:20.164484 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:51:20.164484 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:51:20.164484 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 14:51:20.164484 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 14:51:20.164484 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 14:51:20.164484 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 14:51:20.164484 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 14:51:20.164484 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 14:51:20.164484 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 14:51:20.164484 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 14:51:20.170296 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:51:20.170296 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:51:20.170296 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:51:20.170296 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:51:20.170296 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b4731bf2-0400-41e4-b0b8-3e6b5155f81f could not be found. Aug 18 14:51:20.170296 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:20.170296 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:51:20.170296 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:20.170296 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:20.170296 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:51:20.170296 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:51:20.170296 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:51:20.170296 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:51:20.170296 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 14:51:20.170296 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 14:51:20.170296 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:51:20.170296 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:51:20.170296 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 18 14:51:20.170296 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:51:20.176435 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b4731bf2-0400-41e4-b0b8-3e6b5155f81f could not be found. Aug 18 14:51:20.176435 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:20.176435 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:51:20.176435 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:20.176435 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:20.176435 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:51:20.176435 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:51:20.176435 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:51:20.176435 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:51:20.176435 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b4731bf2-0400-41e4-b0b8-3e6b5155f81f could not be found. Aug 18 14:51:20.176435 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:20.176435 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-001c6c16-bd24-42db-9a05-12642706f380 tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] Returning 404 to user: Volume b4731bf2-0400-41e4-b0b8-3e6b5155f81f could not be found. {{(pid=132267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:51:20.181084 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-001c6c16-bd24-42db-9a05-12642706f380 tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/b4731bf2-0400-41e4-b0b8-3e6b5155f81f" status: 404 len: 109 microversion: 2.1 time: 0.152830 Aug 18 14:51:20.184381 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 7/7] 10.222.0.36 () {58 vars in 1248 bytes} [Thu Aug 18 14:51:20 2022] DELETE /compute/v2.1/os-volumes/b4731bf2-0400-41e4-b0b8-3e6b5155f81f => generated 109 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:51:20.192303 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-82f8d772-d312-44cb-a2d9-a00614d4334b tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] Calling method '.version_select at 0x7fb2150e2a60>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:20.550965 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.wsgi [None req-82f8d772-d312-44cb-a2d9-a00614d4334b tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] HTTP exception thrown: Volume 972ecaf1-8774-4762-a178-ede7b83de21b could not be found. Aug 18 14:51:20.555928 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-82f8d772-d312-44cb-a2d9-a00614d4334b tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] Request method failure captured: Aug 18 14:51:20.555928 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: request: GET /compute/v2.1/os-volumes/972ecaf1-8774-4762-a178-ede7b83de21b HTTP/1.1 Aug 18 14:51:20.555928 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept: application/json Aug 18 14:51:20.555928 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept-Encoding: identity Aug 18 14:51:20.555928 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Connection: close Aug 18 14:51:20.555928 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Length: 0 Aug 18 14:51:20.555928 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Type: application/json Aug 18 14:51:20.555928 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Host: 10.222.0.36 Aug 18 14:51:20.555928 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Openstack-System-Scope: None Aug 18 14:51:20.555928 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: User-Agent: python-urllib3/1.26.11 Aug 18 14:51:20.555928 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Auth-Token: gAAAAABi_lHl7sxQiNT17m1-bYqvPa1VzgCY8BEe5COX1ZkGUNIECTBZtzTgmtDvxCfKfM92BHC2oArCSQ6L8w4OmBU8H0QFMaPdNgq3j1-Jn1KDblluKc_OTgCsFcX90yyMOVux2v_64MuB9Jv1_VfaO27TJhKKZ-4K7daWA-cZL0D5C7XJ_wE Aug 18 14:51:20.555928 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Id: None Aug 18 14:51:20.555928 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Name: None Aug 18 14:51:20.555928 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Identity-Status: Confirmed Aug 18 14:51:20.555928 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Is-Admin-Project: True Aug 18 14:51:20.555928 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Id: default Aug 18 14:51:20.555928 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Name: Default Aug 18 14:51:20.555928 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Id: 7e523324eb6745e0a8b6f2c147c91312 Aug 18 14:51:20.555928 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Name: tempest-VolumesNegativeTest-629935173 Aug 18 14:51:20.555928 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Role: reader,member Aug 18 14:51:20.555928 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Roles: reader,member Aug 18 14:51:20.558250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7e523324eb6745e0a8b6f2c147c91312"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7e523324eb6745e0a8b6f2c147c91312"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7e523324eb6745e0a8b6f2c147c91312", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7e523324eb6745e0a8b6f2c147c91312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:51:20.558250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant: tempest-VolumesNegativeTest-629935173 Aug 18 14:51:20.558250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Id: 7e523324eb6745e0a8b6f2c147c91312 Aug 18 14:51:20.558250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Name: tempest-VolumesNegativeTest-629935173 Aug 18 14:51:20.558250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User: tempest-VolumesNegativeTest-629935173-project Aug 18 14:51:20.558250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Id: default Aug 18 14:51:20.558250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Name: Default Aug 18 14:51:20.558250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Id: 5f0c269f8bfd426b9eb18e011168040b Aug 18 14:51:20.558250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Name: tempest-VolumesNegativeTest-629935173-project Aug 18 14:51:20.558250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: method: Aug 18 14:51:20.558250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: exception: Volume 972ecaf1-8774-4762-a178-ede7b83de21b could not be found. Aug 18 14:51:20.558250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: action_args: {'id': '972ecaf1-8774-4762-a178-ede7b83de21b'} Aug 18 14:51:20.558250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:51:20.559950 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:20.559950 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:51:20.559950 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:51:20.559950 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 14:51:20.559950 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 14:51:20.559950 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 14:51:20.559950 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 14:51:20.559950 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 14:51:20.559950 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 14:51:20.559950 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 14:51:20.559950 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 14:51:20.559950 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:51:20.559950 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:51:20.559950 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:51:20.559950 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:51:20.559950 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 972ecaf1-8774-4762-a178-ede7b83de21b could not be found. (HTTP 404) (Request-ID: req-153e2cd7-3755-4655-896d-e3ccfc36a564) Aug 18 14:51:20.559950 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:20.559950 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:51:20.559950 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:20.561910 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:20.561910 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 14:51:20.561910 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 14:51:20.561910 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 14:51:20.561910 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 14:51:20.561910 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 14:51:20.561910 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 14:51:20.561910 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 14:51:20.561910 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 14:51:20.561910 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:51:20.561910 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:51:20.561910 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 14:51:20.561910 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 14:51:20.561910 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 14:51:20.561910 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 14:51:20.561910 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 14:51:20.561910 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 14:51:20.561910 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 14:51:20.561910 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 14:51:20.563981 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:51:20.563981 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:51:20.563981 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:51:20.563981 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:51:20.563981 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 972ecaf1-8774-4762-a178-ede7b83de21b could not be found. Aug 18 14:51:20.563981 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:20.563981 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:51:20.563981 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:20.563981 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:20.563981 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:51:20.563981 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:51:20.563981 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:51:20.563981 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:51:20.563981 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 14:51:20.563981 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 14:51:20.563981 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:51:20.563981 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:51:20.563981 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 14:51:20.563981 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:51:20.568575 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 972ecaf1-8774-4762-a178-ede7b83de21b could not be found. Aug 18 14:51:20.568575 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:20.568575 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:51:20.568575 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:20.568575 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:20.568575 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:51:20.568575 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:51:20.568575 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:51:20.568575 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:51:20.568575 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 972ecaf1-8774-4762-a178-ede7b83de21b could not be found. Aug 18 14:51:20.568575 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:20.568575 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-82f8d772-d312-44cb-a2d9-a00614d4334b tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] Returning 404 to user: Volume 972ecaf1-8774-4762-a178-ede7b83de21b could not be found. {{(pid=132267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:51:20.573733 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-82f8d772-d312-44cb-a2d9-a00614d4334b tempest-VolumesNegativeTest-629935173 tempest-VolumesNegativeTest-629935173-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/972ecaf1-8774-4762-a178-ede7b83de21b" status: 404 len: 109 microversion: 2.1 time: 0.378814 Aug 18 14:51:20.591474 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 8/8] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Aug 18 14:51:20 2022] GET /compute/v2.1/os-volumes/972ecaf1-8774-4762-a178-ede7b83de21b => generated 109 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:51:20.660920 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-60aeb75a-4e89-436a-9c56-8b9f690bfde8 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.429435 Aug 18 14:51:20.662829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 1/9] 10.222.0.36 () {60 vars in 1155 bytes} [Thu Aug 18 14:51:18 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2434 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 18 14:51:20.678655 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-8d0debcd-ac0e-4f7a-92bd-428fce7a2f52 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] Calling method '.version_select at 0x7fb2150e2f70>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:20.742781 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2f2c1799-d194-47d1-8b3f-317266239478 tempest-VolumesTestJSON-654926911 tempest-VolumesTestJSON-654926911-project] Calling method '.version_select at 0x7fb21507a3a0>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:20.825148 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-8d0debcd-ac0e-4f7a-92bd-428fce7a2f52 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/d274e87a-cc3a-445a-a5e6-fb2f779ba527" status: 200 len: 344 microversion: 2.1 time: 0.151654 Aug 18 14:51:20.825786 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 9/10] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Aug 18 14:51:20 2022] GET /compute/v2.1/os-volumes/d274e87a-cc3a-445a-a5e6-fb2f779ba527 => generated 344 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:51:20.966828 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2f2c1799-d194-47d1-8b3f-317266239478 tempest-VolumesTestJSON-654926911 tempest-VolumesTestJSON-654926911-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/35fc28c0-f2b2-4abb-884f-eb2c233ad2c5" status: 200 len: 351 microversion: 2.1 time: 0.228858 Aug 18 14:51:20.967348 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 2/11] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Aug 18 14:51:20 2022] GET /compute/v2.1/os-volumes/35fc28c0-f2b2-4abb-884f-eb2c233ad2c5 => generated 351 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:51:21.840595 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-77297e39-ecbe-491d-9991-00b25175fa36 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] Calling method '.version_select at 0x7fb215014310>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:21.943743 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-77297e39-ecbe-491d-9991-00b25175fa36 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/d274e87a-cc3a-445a-a5e6-fb2f779ba527" status: 200 len: 345 microversion: 2.1 time: 0.107683 Aug 18 14:51:21.945436 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 10/12] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Aug 18 14:51:21 2022] GET /compute/v2.1/os-volumes/d274e87a-cc3a-445a-a5e6-fb2f779ba527 => generated 345 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:51:21.960402 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-46186528-c6de-45d1-a09e-cc079516a554 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] Action: 'create', calling method: .version_select at 0x7fb21507aa60>, body: {"snapshot": {"volume_id": "d274e87a-cc3a-445a-a5e6-fb2f779ba527", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-9168891"}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:51:22.694023 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-46186528-c6de-45d1-a09e-cc079516a554 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 284 microversion: 2.1 time: 0.737689 Aug 18 14:51:22.695031 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 3/13] 10.222.0.36 () {60 vars in 1162 bytes} [Thu Aug 18 14:51:21 2022] POST /compute/v2.1/os-snapshots => generated 284 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:51:22.706091 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-307fc87e-6049-488f-921c-6631bacd868a tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] Calling method '.version_select at 0x7fb2150144c0>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:22.766085 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-307fc87e-6049-488f-921c-6631bacd868a tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/27d7eff4-71fa-4370-b8ad-d6ab1040e3a1" status: 200 len: 284 microversion: 2.1 time: 0.064222 Aug 18 14:51:22.766878 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 11/14] 10.222.0.36 () {58 vars in 1251 bytes} [Thu Aug 18 14:51:22 2022] GET /compute/v2.1/os-snapshots/27d7eff4-71fa-4370-b8ad-d6ab1040e3a1 => generated 284 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:51:22.785308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-21ca4938-5852-4951-9edf-a2b016d142a7 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] Calling method '.version_select at 0x7fb215090af0>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:22.899541 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-21ca4938-5852-4951-9edf-a2b016d142a7 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.124994 Aug 18 14:51:22.902713 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 4/15] 10.222.0.36 () {58 vars in 1140 bytes} [Thu Aug 18 14:51:22 2022] GET /compute/v2.1/os-snapshots => generated 287 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:51:22.912878 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-4a15c09b-6708-434a-8790-6a54d9969e21 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] Calling method '.version_select at 0x7fb21501f0d0>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:23.049919 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-6611eb76-452d-4af8-9d68-930affd91c29 tempest-VolumesTestJSON-654926911 tempest-VolumesTestJSON-654926911-project] Calling method '.version_select at 0x7fb21507a790>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:23.092363 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-4a15c09b-6708-434a-8790-6a54d9969e21 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/27d7eff4-71fa-4370-b8ad-d6ab1040e3a1" status: 200 len: 284 microversion: 2.1 time: 0.183452 Aug 18 14:51:23.097468 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 12/16] 10.222.0.36 () {58 vars in 1251 bytes} [Thu Aug 18 14:51:22 2022] GET /compute/v2.1/os-snapshots/27d7eff4-71fa-4370-b8ad-d6ab1040e3a1 => generated 284 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:51:23.209026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-6611eb76-452d-4af8-9d68-930affd91c29 tempest-VolumesTestJSON-654926911 tempest-VolumesTestJSON-654926911-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/187db6ae-5c6f-46bf-b222-698d3b52e8ac" status: 200 len: 350 microversion: 2.1 time: 0.164587 Aug 18 14:51:23.210009 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 5/17] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Aug 18 14:51:23 2022] GET /compute/v2.1/os-volumes/187db6ae-5c6f-46bf-b222-698d3b52e8ac => generated 350 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:51:24.107457 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-7b89a27f-681f-4d79-8c86-f01d86b6eb08 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] Calling method '.version_select at 0x7fb215014160>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:24.333153 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-7b89a27f-681f-4d79-8c86-f01d86b6eb08 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/27d7eff4-71fa-4370-b8ad-d6ab1040e3a1" status: 200 len: 284 microversion: 2.1 time: 0.232436 Aug 18 14:51:24.335270 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 13/18] 10.222.0.36 () {58 vars in 1251 bytes} [Thu Aug 18 14:51:24 2022] GET /compute/v2.1/os-snapshots/27d7eff4-71fa-4370-b8ad-d6ab1040e3a1 => generated 284 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:51:25.347453 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c80919d5-db8f-4748-970f-a3a07bfa6077 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] Calling method '.version_select at 0x7fb21507a8b0>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:25.424083 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c80919d5-db8f-4748-970f-a3a07bfa6077 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/27d7eff4-71fa-4370-b8ad-d6ab1040e3a1" status: 200 len: 284 microversion: 2.1 time: 0.080614 Aug 18 14:51:25.424849 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 6/19] 10.222.0.36 () {58 vars in 1251 bytes} [Thu Aug 18 14:51:25 2022] GET /compute/v2.1/os-snapshots/27d7eff4-71fa-4370-b8ad-d6ab1040e3a1 => generated 284 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:51:26.439430 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-9553d59b-8272-4660-8e70-6080622f5aff tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] Calling method '.version_select at 0x7fb214fe7b80>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:26.516840 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-9553d59b-8272-4660-8e70-6080622f5aff tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/27d7eff4-71fa-4370-b8ad-d6ab1040e3a1" status: 200 len: 285 microversion: 2.1 time: 0.081750 Aug 18 14:51:26.518137 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 14/20] 10.222.0.36 () {58 vars in 1251 bytes} [Thu Aug 18 14:51:26 2022] GET /compute/v2.1/os-snapshots/27d7eff4-71fa-4370-b8ad-d6ab1040e3a1 => generated 285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:51:26.534359 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5d1c21bc-a528-4334-9d8b-fec08d41f6de tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] Calling method '.version_select at 0x7fb2150950d0>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:26.721937 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-5d1c21bc-a528-4334-9d8b-fec08d41f6de tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/27d7eff4-71fa-4370-b8ad-d6ab1040e3a1" status: 202 len: 0 microversion: 2.1 time: 0.196435 Aug 18 14:51:26.731745 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 7/21] 10.222.0.36 () {58 vars in 1254 bytes} [Thu Aug 18 14:51:26 2022] DELETE /compute/v2.1/os-snapshots/27d7eff4-71fa-4370-b8ad-d6ab1040e3a1 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:51:26.733266 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-e2832fb0-f607-40bf-8e52-e0dcb5d3c3e0 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] Calling method '.version_select at 0x7fb215034820>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:26.876747 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-e2832fb0-f607-40bf-8e52-e0dcb5d3c3e0 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/27d7eff4-71fa-4370-b8ad-d6ab1040e3a1" status: 200 len: 284 microversion: 2.1 time: 0.149442 Aug 18 14:51:26.877816 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 15/22] 10.222.0.36 () {58 vars in 1251 bytes} [Thu Aug 18 14:51:26 2022] GET /compute/v2.1/os-snapshots/27d7eff4-71fa-4370-b8ad-d6ab1040e3a1 => generated 284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:51:27.221283 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-6d4f7de6-2c29-4b32-8ada-af79ebe6590e tempest-VolumesTestJSON-654926911 tempest-VolumesTestJSON-654926911-project] Calling method '.version_select at 0x7fb21507a9d0>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:27.346750 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-6d4f7de6-2c29-4b32-8ada-af79ebe6590e tempest-VolumesTestJSON-654926911 tempest-VolumesTestJSON-654926911-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/72235c31-5372-41fa-a2ce-60effe8f8c9d" status: 200 len: 351 microversion: 2.1 time: 0.129150 Aug 18 14:51:27.355216 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 8/23] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Aug 18 14:51:27 2022] GET /compute/v2.1/os-volumes/72235c31-5372-41fa-a2ce-60effe8f8c9d => generated 351 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:51:27.361777 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-839f53cb-72d5-43bb-b415-07a14072cfdc tempest-VolumesTestJSON-654926911 tempest-VolumesTestJSON-654926911-project] Calling method '.version_select at 0x7fb21501f4c0>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:27.593751 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-839f53cb-72d5-43bb-b415-07a14072cfdc tempest-VolumesTestJSON-654926911 tempest-VolumesTestJSON-654926911-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.237245 Aug 18 14:51:27.595341 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 16/24] 10.222.0.36 () {58 vars in 1134 bytes} [Thu Aug 18 14:51:27 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:27.614134 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-f50a441e-98ec-4d22-afb4-501e5d1c4722 tempest-VolumesTestJSON-654926911 tempest-VolumesTestJSON-654926911-project] Calling method '.version_select at 0x7fb215014d30>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:27.837263 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-f50a441e-98ec-4d22-afb4-501e5d1c4722 tempest-VolumesTestJSON-654926911 tempest-VolumesTestJSON-654926911-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.232035 Aug 18 14:51:27.840752 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 17/25] 10.222.0.36 () {58 vars in 1149 bytes} [Thu Aug 18 14:51:27 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:51:27.856185 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-05c5c2d4-97a3-4501-84bd-2eb941fa3dd2 tempest-VolumesTestJSON-654926911 tempest-VolumesTestJSON-654926911-project] Calling method '.version_select at 0x7fb21501fa60>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:27.960971 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-79fedf50-5960-4712-b5dd-7c1df8471341 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-221828703", "imageRef": "4083d76b-6b95-4ed8-8053-69a1270afbd4", "flavorRef": "452", "networks": [{"uuid": "94d70b25-d5b0-4d5f-94f2-7794bfcae351"}]}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:51:28.077919 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-05c5c2d4-97a3-4501-84bd-2eb941fa3dd2 tempest-VolumesTestJSON-654926911 tempest-VolumesTestJSON-654926911-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.227505 Aug 18 14:51:28.078557 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 18/26] 10.222.0.36 () {58 vars in 1134 bytes} [Thu Aug 18 14:51:27 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:51:28.092431 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-4779b449-4e88-41ff-9e8b-d02667a8c636 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] Calling method '.version_select at 0x7fb214fa6ca0>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:28.185868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.network.neutron [None req-79fedf50-5960-4712-b5dd-7c1df8471341 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] validate_networks() for [('94d70b25-d5b0-4d5f-94f2-7794bfcae351', None, None, None, None, None)] {{(pid=132268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:51:28.194833 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.wsgi [None req-4779b449-4e88-41ff-9e8b-d02667a8c636 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] HTTP exception thrown: Snapshot 27d7eff4-71fa-4370-b8ad-d6ab1040e3a1 could not be found. Aug 18 14:51:28.206877 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-4779b449-4e88-41ff-9e8b-d02667a8c636 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] Request method failure captured: Aug 18 14:51:28.206877 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: request: GET /compute/v2.1/os-snapshots/27d7eff4-71fa-4370-b8ad-d6ab1040e3a1 HTTP/1.1 Aug 18 14:51:28.206877 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept: application/json Aug 18 14:51:28.206877 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept-Encoding: identity Aug 18 14:51:28.206877 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Connection: close Aug 18 14:51:28.206877 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Length: 0 Aug 18 14:51:28.206877 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Type: application/json Aug 18 14:51:28.206877 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Host: 10.222.0.36 Aug 18 14:51:28.206877 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Openstack-System-Scope: None Aug 18 14:51:28.206877 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: User-Agent: python-urllib3/1.26.11 Aug 18 14:51:28.206877 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Auth-Token: gAAAAABi_lHmmwhy7GZ4RALlChNUHI_z9_CR9od8_QaQip35cZkMjbv-eIg75ZZh4aibJriQ2zM2jvw5-dTv13BekxN70ZGGaeO5Y8LXYyVklo9_JPqYGO34bbERbQ3V3EOZRWjswadqwaRfKTDet84xv_H8XGnBY_NF5bxVgm9roa_X_ksVMoc Aug 18 14:51:28.206877 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Id: None Aug 18 14:51:28.206877 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Name: None Aug 18 14:51:28.206877 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Identity-Status: Confirmed Aug 18 14:51:28.206877 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Is-Admin-Project: True Aug 18 14:51:28.206877 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Id: default Aug 18 14:51:28.206877 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Name: Default Aug 18 14:51:28.206877 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Id: aded651ca7894034b7495f2fc3d58f51 Aug 18 14:51:28.206877 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-288793550 Aug 18 14:51:28.206877 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Role: reader,member Aug 18 14:51:28.206877 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Roles: reader,member Aug 18 14:51:28.208054 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aded651ca7894034b7495f2fc3d58f51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aded651ca7894034b7495f2fc3d58f51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_aded651ca7894034b7495f2fc3d58f51", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/aded651ca7894034b7495f2fc3d58f51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:51:28.208054 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant: tempest-VolumesSnapshotsTestJSON-288793550 Aug 18 14:51:28.208054 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Id: aded651ca7894034b7495f2fc3d58f51 Aug 18 14:51:28.208054 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-288793550 Aug 18 14:51:28.208054 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User: tempest-VolumesSnapshotsTestJSON-288793550-project Aug 18 14:51:28.208054 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Id: default Aug 18 14:51:28.208054 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Name: Default Aug 18 14:51:28.208054 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Id: ad318bf4dd64445496bd87d0bd64f3e2 Aug 18 14:51:28.208054 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Name: tempest-VolumesSnapshotsTestJSON-288793550-project Aug 18 14:51:28.208054 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: method: Aug 18 14:51:28.208054 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: exception: Snapshot 27d7eff4-71fa-4370-b8ad-d6ab1040e3a1 could not be found. Aug 18 14:51:28.208054 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: action_args: {'id': '27d7eff4-71fa-4370-b8ad-d6ab1040e3a1'} Aug 18 14:51:28.208054 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:51:28.208824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:28.208824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 18 14:51:28.208824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 18 14:51:28.208824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 18 14:51:28.208824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 18 14:51:28.208824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 18 14:51:28.208824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 18 14:51:28.208824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 14:51:28.208824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 14:51:28.208824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 14:51:28.208824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 14:51:28.208824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:51:28.208824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:51:28.208824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:51:28.208824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:51:28.208824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 27d7eff4-71fa-4370-b8ad-d6ab1040e3a1 could not be found. (HTTP 404) (Request-ID: req-5d992b23-ae5f-4bcd-aea5-a0eac1aef405) Aug 18 14:51:28.208824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:28.208824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:51:28.210353 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:28.210353 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:28.210353 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 18 14:51:28.210353 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 18 14:51:28.210353 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 14:51:28.210353 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 14:51:28.210353 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 18 14:51:28.210353 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 18 14:51:28.210353 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 14:51:28.210353 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 14:51:28.210353 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 18 14:51:28.210353 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 18 14:51:28.210353 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 18 14:51:28.210353 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 18 14:51:28.210353 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 18 14:51:28.210353 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 18 14:51:28.210353 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 14:51:28.210353 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 14:51:28.210353 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 14:51:28.212736 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 14:51:28.212736 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:51:28.212736 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:51:28.212736 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:51:28.212736 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:51:28.212736 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 27d7eff4-71fa-4370-b8ad-d6ab1040e3a1 could not be found. Aug 18 14:51:28.212736 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:28.212736 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:51:28.212736 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:28.212736 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:28.212736 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:51:28.212736 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:51:28.212736 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:51:28.212736 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:51:28.212736 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 14:51:28.212736 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 14:51:28.212736 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:51:28.212736 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:51:28.212736 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 18 14:51:28.212736 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:51:28.216819 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 27d7eff4-71fa-4370-b8ad-d6ab1040e3a1 could not be found. Aug 18 14:51:28.216819 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:28.216819 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:51:28.216819 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:28.216819 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:28.216819 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:51:28.216819 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:51:28.216819 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:51:28.216819 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:51:28.216819 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 27d7eff4-71fa-4370-b8ad-d6ab1040e3a1 could not be found. Aug 18 14:51:28.216819 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:28.216819 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-4779b449-4e88-41ff-9e8b-d02667a8c636 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] Returning 404 to user: Snapshot 27d7eff4-71fa-4370-b8ad-d6ab1040e3a1 could not be found. {{(pid=132267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:51:28.216819 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-4779b449-4e88-41ff-9e8b-d02667a8c636 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/27d7eff4-71fa-4370-b8ad-d6ab1040e3a1" status: 404 len: 111 microversion: 2.1 time: 0.128879 Aug 18 14:51:28.216819 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 19/27] 10.222.0.36 () {58 vars in 1251 bytes} [Thu Aug 18 14:51:28 2022] GET /compute/v2.1/os-snapshots/27d7eff4-71fa-4370-b8ad-d6ab1040e3a1 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:51:28.221560 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-bee1e560-924e-4ab1-83ee-21dd8df5176d tempest-VolumesTestJSON-654926911 tempest-VolumesTestJSON-654926911-project] Calling method '.version_select at 0x7fb214fa6d30>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:28.326695 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-bee1e560-924e-4ab1-83ee-21dd8df5176d tempest-VolumesTestJSON-654926911 tempest-VolumesTestJSON-654926911-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.116318 Aug 18 14:51:28.327367 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 20/28] 10.222.0.36 () {58 vars in 1167 bytes} [Thu Aug 18 14:51:28 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:51:28.332362 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-49617a53-546b-4159-be72-aef83d205a7a tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] Calling method '.version_select at 0x7fb215014700>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:28.424020 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-49617a53-546b-4159-be72-aef83d205a7a tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/d274e87a-cc3a-445a-a5e6-fb2f779ba527" status: 202 len: 0 microversion: 2.1 time: 0.095089 Aug 18 14:51:28.424975 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 21/29] 10.222.0.36 () {58 vars in 1248 bytes} [Thu Aug 18 14:51:28 2022] DELETE /compute/v2.1/os-volumes/d274e87a-cc3a-445a-a5e6-fb2f779ba527 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:51:28.432081 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-dbe87bee-e706-42f7-81c8-37b62556641e tempest-VolumesTestJSON-654926911 tempest-VolumesTestJSON-654926911-project] Calling method '.version_select at 0x7fb21501fc10>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:28.699098 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-dbe87bee-e706-42f7-81c8-37b62556641e tempest-VolumesTestJSON-654926911 tempest-VolumesTestJSON-654926911-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.272735 Aug 18 14:51:28.703929 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 22/30] 10.222.0.36 () {58 vars in 1170 bytes} [Thu Aug 18 14:51:28 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:51:28.708719 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-0af576ec-4d7a-4560-bef9-b35e5088d5e4 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] Calling method '.version_select at 0x7fb215014160>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:28.819283 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-0af576ec-4d7a-4560-bef9-b35e5088d5e4 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/d274e87a-cc3a-445a-a5e6-fb2f779ba527" status: 200 len: 344 microversion: 2.1 time: 0.114182 Aug 18 14:51:28.820169 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 23/31] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Aug 18 14:51:28 2022] GET /compute/v2.1/os-volumes/d274e87a-cc3a-445a-a5e6-fb2f779ba527 => generated 344 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:51:28.827388 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-c5bec5c6-9f10-4835-a5f4-daae5363f1cd tempest-VolumesTestJSON-654926911 tempest-VolumesTestJSON-654926911-project] Calling method '.version_select at 0x7fb215014790>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:28.975626 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-c5bec5c6-9f10-4835-a5f4-daae5363f1cd tempest-VolumesTestJSON-654926911 tempest-VolumesTestJSON-654926911-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.152919 Aug 18 14:51:28.976242 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 24/32] 10.222.0.36 () {58 vars in 1155 bytes} [Thu Aug 18 14:51:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:28.989939 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-b96ca5d6-48b8-444d-af0d-c899eb4a94cc tempest-VolumesTestJSON-654926911 tempest-VolumesTestJSON-654926911-project] Calling method '.version_select at 0x7fb214fe7af0>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:29.233819 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-b96ca5d6-48b8-444d-af0d-c899eb4a94cc tempest-VolumesTestJSON-654926911 tempest-VolumesTestJSON-654926911-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.248194 Aug 18 14:51:29.234909 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 25/33] 10.222.0.36 () {58 vars in 1188 bytes} [Thu Aug 18 14:51:28 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:51:29.248397 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-1318ce01-b256-42ed-a0a9-5ce4e8b4da2b tempest-VolumesTestJSON-654926911 tempest-VolumesTestJSON-654926911-project] Calling method '.version_select at 0x7fb214fa6670>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:29.466854 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-1318ce01-b256-42ed-a0a9-5ce4e8b4da2b tempest-VolumesTestJSON-654926911 tempest-VolumesTestJSON-654926911-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.222901 Aug 18 14:51:29.468244 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 26/34] 10.222.0.36 () {58 vars in 1155 bytes} [Thu Aug 18 14:51:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:51:29.834598 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-0ea7022c-3b44-4b14-bad9-70477783d5ed tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] Calling method '.version_select at 0x7fb21501fa60>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:29.941468 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-0ea7022c-3b44-4b14-bad9-70477783d5ed tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/d274e87a-cc3a-445a-a5e6-fb2f779ba527" status: 200 len: 344 microversion: 2.1 time: 0.111325 Aug 18 14:51:29.949103 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 27/35] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Aug 18 14:51:29 2022] GET /compute/v2.1/os-volumes/d274e87a-cc3a-445a-a5e6-fb2f779ba527 => generated 344 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:51:30.905067 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-79fedf50-5960-4712-b5dd-7c1df8471341 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Flavor limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:51:30.906690 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-79fedf50-5960-4712-b5dd-7c1df8471341 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Image limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:51:30.910445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-79fedf50-5960-4712-b5dd-7c1df8471341 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Flavor pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:51:30.912248 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-79fedf50-5960-4712-b5dd-7c1df8471341 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Image pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:51:30.916238 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-79fedf50-5960-4712-b5dd-7c1df8471341 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:51:30.956856 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-5f6b401c-1f06-4a54-b66a-c72688805a87 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] Calling method '.version_select at 0x7fb21501f940>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:30.977528 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-79fedf50-5960-4712-b5dd-7c1df8471341 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:30.979916 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-79fedf50-5960-4712-b5dd-7c1df8471341 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:30.980660 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-79fedf50-5960-4712-b5dd-7c1df8471341 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:30.985454 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-79fedf50-5960-4712-b5dd-7c1df8471341 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:30.987330 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-79fedf50-5960-4712-b5dd-7c1df8471341 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:30.988764 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-79fedf50-5960-4712-b5dd-7c1df8471341 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:31.072172 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.wsgi [None req-5f6b401c-1f06-4a54-b66a-c72688805a87 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] HTTP exception thrown: Volume d274e87a-cc3a-445a-a5e6-fb2f779ba527 could not be found. Aug 18 14:51:31.074998 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-5f6b401c-1f06-4a54-b66a-c72688805a87 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] Request method failure captured: Aug 18 14:51:31.074998 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: request: GET /compute/v2.1/os-volumes/d274e87a-cc3a-445a-a5e6-fb2f779ba527 HTTP/1.1 Aug 18 14:51:31.074998 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept: application/json Aug 18 14:51:31.074998 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept-Encoding: identity Aug 18 14:51:31.074998 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Connection: close Aug 18 14:51:31.074998 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Length: 0 Aug 18 14:51:31.074998 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Type: application/json Aug 18 14:51:31.074998 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Host: 10.222.0.36 Aug 18 14:51:31.074998 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Openstack-System-Scope: None Aug 18 14:51:31.074998 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: User-Agent: python-urllib3/1.26.11 Aug 18 14:51:31.074998 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Auth-Token: gAAAAABi_lHmmwhy7GZ4RALlChNUHI_z9_CR9od8_QaQip35cZkMjbv-eIg75ZZh4aibJriQ2zM2jvw5-dTv13BekxN70ZGGaeO5Y8LXYyVklo9_JPqYGO34bbERbQ3V3EOZRWjswadqwaRfKTDet84xv_H8XGnBY_NF5bxVgm9roa_X_ksVMoc Aug 18 14:51:31.074998 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Id: None Aug 18 14:51:31.074998 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Name: None Aug 18 14:51:31.074998 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Identity-Status: Confirmed Aug 18 14:51:31.074998 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Is-Admin-Project: True Aug 18 14:51:31.074998 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Id: default Aug 18 14:51:31.074998 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Name: Default Aug 18 14:51:31.074998 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Id: aded651ca7894034b7495f2fc3d58f51 Aug 18 14:51:31.074998 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-288793550 Aug 18 14:51:31.074998 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Role: reader,member Aug 18 14:51:31.074998 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Roles: reader,member Aug 18 14:51:31.076250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aded651ca7894034b7495f2fc3d58f51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aded651ca7894034b7495f2fc3d58f51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_aded651ca7894034b7495f2fc3d58f51", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/aded651ca7894034b7495f2fc3d58f51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:51:31.076250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant: tempest-VolumesSnapshotsTestJSON-288793550 Aug 18 14:51:31.076250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Id: aded651ca7894034b7495f2fc3d58f51 Aug 18 14:51:31.076250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-288793550 Aug 18 14:51:31.076250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User: tempest-VolumesSnapshotsTestJSON-288793550-project Aug 18 14:51:31.076250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Id: default Aug 18 14:51:31.076250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Name: Default Aug 18 14:51:31.076250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Id: ad318bf4dd64445496bd87d0bd64f3e2 Aug 18 14:51:31.076250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Name: tempest-VolumesSnapshotsTestJSON-288793550-project Aug 18 14:51:31.076250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: method: Aug 18 14:51:31.076250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: exception: Volume d274e87a-cc3a-445a-a5e6-fb2f779ba527 could not be found. Aug 18 14:51:31.076250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: action_args: {'id': 'd274e87a-cc3a-445a-a5e6-fb2f779ba527'} Aug 18 14:51:31.076250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:51:31.077013 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:31.077013 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:51:31.077013 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:51:31.077013 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 14:51:31.077013 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 14:51:31.077013 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 14:51:31.077013 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 14:51:31.077013 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 14:51:31.077013 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 14:51:31.077013 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 14:51:31.077013 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 14:51:31.077013 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:51:31.077013 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:51:31.077013 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:51:31.077013 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:51:31.077013 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d274e87a-cc3a-445a-a5e6-fb2f779ba527 could not be found. (HTTP 404) (Request-ID: req-9f8ca244-7dc0-49f9-9041-bd340b824880) Aug 18 14:51:31.077013 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:31.077013 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:51:31.077013 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:31.078040 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:31.078040 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 14:51:31.078040 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 14:51:31.078040 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 14:51:31.078040 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 14:51:31.078040 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 14:51:31.078040 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 14:51:31.078040 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 14:51:31.078040 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 14:51:31.078040 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:51:31.078040 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:51:31.078040 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 14:51:31.078040 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 14:51:31.078040 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 14:51:31.078040 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 14:51:31.078040 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 14:51:31.078040 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 14:51:31.078040 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 14:51:31.078040 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 14:51:31.079052 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:51:31.079052 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:51:31.079052 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:51:31.079052 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:51:31.079052 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d274e87a-cc3a-445a-a5e6-fb2f779ba527 could not be found. Aug 18 14:51:31.079052 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:31.079052 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:51:31.079052 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:31.079052 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:31.079052 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:51:31.079052 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:51:31.079052 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:51:31.079052 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:51:31.079052 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 14:51:31.079052 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 14:51:31.079052 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:51:31.079052 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:51:31.079052 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 14:51:31.079052 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:51:31.080103 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d274e87a-cc3a-445a-a5e6-fb2f779ba527 could not be found. Aug 18 14:51:31.080103 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:31.080103 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:51:31.080103 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:31.080103 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:31.080103 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:51:31.080103 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:51:31.080103 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:51:31.080103 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:51:31.080103 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d274e87a-cc3a-445a-a5e6-fb2f779ba527 could not be found. Aug 18 14:51:31.080103 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:31.084097 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-5f6b401c-1f06-4a54-b66a-c72688805a87 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] Returning 404 to user: Volume d274e87a-cc3a-445a-a5e6-fb2f779ba527 could not be found. {{(pid=132267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:51:31.085251 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-5f6b401c-1f06-4a54-b66a-c72688805a87 tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/d274e87a-cc3a-445a-a5e6-fb2f779ba527" status: 404 len: 109 microversion: 2.1 time: 0.133462 Aug 18 14:51:31.086023 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 28/36] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Aug 18 14:51:30 2022] GET /compute/v2.1/os-volumes/d274e87a-cc3a-445a-a5e6-fb2f779ba527 => generated 109 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 14:51:31.112291 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-4a23907c-4094-4adf-a6c7-1e7a268e842a tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] Calling method '.version_select at 0x7fb214fa65e0>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:31.124656 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-79fedf50-5960-4712-b5dd-7c1df8471341 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Getting quotas for project 2a38dab41aca4c2d9258599840ce93d5. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:51:31.140378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-79fedf50-5960-4712-b5dd-7c1df8471341 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Getting quotas for user 1469a960bd9241008cfb112a28bcd5d3 and project 2a38dab41aca4c2d9258599840ce93d5. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:51:31.184576 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-79fedf50-5960-4712-b5dd-7c1df8471341 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Going to run 1 instances... {{(pid=132268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:51:31.194100 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-79fedf50-5960-4712-b5dd-7c1df8471341 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4083d76b-6b95-4ed8-8053-69a1270afbd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:51:31.296175 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.wsgi [None req-4a23907c-4094-4adf-a6c7-1e7a268e842a tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] HTTP exception thrown: Volume d274e87a-cc3a-445a-a5e6-fb2f779ba527 could not be found. Aug 18 14:51:31.302569 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-4a23907c-4094-4adf-a6c7-1e7a268e842a tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] Request method failure captured: Aug 18 14:51:31.302569 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: request: DELETE /compute/v2.1/os-volumes/d274e87a-cc3a-445a-a5e6-fb2f779ba527 HTTP/1.1 Aug 18 14:51:31.302569 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept: application/json Aug 18 14:51:31.302569 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept-Encoding: identity Aug 18 14:51:31.302569 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Connection: close Aug 18 14:51:31.302569 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Length: 0 Aug 18 14:51:31.302569 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Type: application/json Aug 18 14:51:31.302569 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Host: 10.222.0.36 Aug 18 14:51:31.302569 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Openstack-System-Scope: None Aug 18 14:51:31.302569 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: User-Agent: python-urllib3/1.26.11 Aug 18 14:51:31.302569 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Auth-Token: gAAAAABi_lHmmwhy7GZ4RALlChNUHI_z9_CR9od8_QaQip35cZkMjbv-eIg75ZZh4aibJriQ2zM2jvw5-dTv13BekxN70ZGGaeO5Y8LXYyVklo9_JPqYGO34bbERbQ3V3EOZRWjswadqwaRfKTDet84xv_H8XGnBY_NF5bxVgm9roa_X_ksVMoc Aug 18 14:51:31.302569 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Id: None Aug 18 14:51:31.302569 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Name: None Aug 18 14:51:31.302569 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Identity-Status: Confirmed Aug 18 14:51:31.302569 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Is-Admin-Project: True Aug 18 14:51:31.302569 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Id: default Aug 18 14:51:31.302569 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Name: Default Aug 18 14:51:31.302569 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Id: aded651ca7894034b7495f2fc3d58f51 Aug 18 14:51:31.302569 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-288793550 Aug 18 14:51:31.302569 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Role: reader,member Aug 18 14:51:31.302569 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Roles: reader,member Aug 18 14:51:31.305460 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aded651ca7894034b7495f2fc3d58f51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aded651ca7894034b7495f2fc3d58f51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_aded651ca7894034b7495f2fc3d58f51", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/aded651ca7894034b7495f2fc3d58f51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:51:31.305460 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant: tempest-VolumesSnapshotsTestJSON-288793550 Aug 18 14:51:31.305460 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Id: aded651ca7894034b7495f2fc3d58f51 Aug 18 14:51:31.305460 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-288793550 Aug 18 14:51:31.305460 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User: tempest-VolumesSnapshotsTestJSON-288793550-project Aug 18 14:51:31.305460 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Id: default Aug 18 14:51:31.305460 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Name: Default Aug 18 14:51:31.305460 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Id: ad318bf4dd64445496bd87d0bd64f3e2 Aug 18 14:51:31.305460 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Name: tempest-VolumesSnapshotsTestJSON-288793550-project Aug 18 14:51:31.305460 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: method: Aug 18 14:51:31.305460 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: exception: Volume d274e87a-cc3a-445a-a5e6-fb2f779ba527 could not be found. Aug 18 14:51:31.305460 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: action_args: {'id': 'd274e87a-cc3a-445a-a5e6-fb2f779ba527'} Aug 18 14:51:31.305460 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:51:31.308517 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:31.308517 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:51:31.308517 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:51:31.308517 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 14:51:31.308517 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 14:51:31.308517 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 14:51:31.308517 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 14:51:31.308517 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 14:51:31.308517 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 14:51:31.308517 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 14:51:31.308517 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 14:51:31.308517 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:51:31.308517 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:51:31.308517 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:51:31.308517 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:51:31.308517 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d274e87a-cc3a-445a-a5e6-fb2f779ba527 could not be found. (HTTP 404) (Request-ID: req-29bd1595-9b29-4ef7-bcbe-36555d4feb32) Aug 18 14:51:31.308517 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:31.308517 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:51:31.308517 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:31.310512 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:31.310512 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 18 14:51:31.310512 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 18 14:51:31.310512 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 14:51:31.310512 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 14:51:31.310512 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 14:51:31.310512 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 14:51:31.310512 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 14:51:31.310512 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 14:51:31.310512 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:51:31.310512 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:51:31.310512 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 14:51:31.310512 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 14:51:31.310512 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 14:51:31.310512 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 14:51:31.310512 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 14:51:31.310512 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 14:51:31.310512 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 14:51:31.310512 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 14:51:31.314146 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:51:31.314146 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:51:31.314146 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:51:31.314146 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:51:31.314146 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d274e87a-cc3a-445a-a5e6-fb2f779ba527 could not be found. Aug 18 14:51:31.314146 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:31.314146 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:51:31.314146 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:31.314146 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:31.314146 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:51:31.314146 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:51:31.314146 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:51:31.314146 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:51:31.314146 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 14:51:31.314146 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 14:51:31.314146 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:51:31.314146 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:51:31.314146 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 18 14:51:31.314146 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:51:31.322102 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d274e87a-cc3a-445a-a5e6-fb2f779ba527 could not be found. Aug 18 14:51:31.322102 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:31.322102 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:51:31.322102 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:31.322102 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:31.322102 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:51:31.322102 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:51:31.322102 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:51:31.322102 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:51:31.322102 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d274e87a-cc3a-445a-a5e6-fb2f779ba527 could not be found. Aug 18 14:51:31.322102 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:31.353938 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-4a23907c-4094-4adf-a6c7-1e7a268e842a tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] Returning 404 to user: Volume d274e87a-cc3a-445a-a5e6-fb2f779ba527 could not be found. {{(pid=132267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:51:31.359921 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-4a23907c-4094-4adf-a6c7-1e7a268e842a tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/d274e87a-cc3a-445a-a5e6-fb2f779ba527" status: 404 len: 109 microversion: 2.1 time: 0.263055 Aug 18 14:51:31.379650 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 29/37] 10.222.0.36 () {58 vars in 1248 bytes} [Thu Aug 18 14:51:31 2022] DELETE /compute/v2.1/os-volumes/d274e87a-cc3a-445a-a5e6-fb2f779ba527 => generated 109 bytes in 284 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:51:31.390260 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-79fedf50-5960-4712-b5dd-7c1df8471341 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.815833 Aug 18 14:51:31.391406 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 9/38] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Aug 18 14:51:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:51:31.408593 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5d28c080-78a1-4994-aa56-fecdf2beda26 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:31.409506 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-5d28c080-78a1-4994-aa56-fecdf2beda26 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:31.430201 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-a2aae33c-cced-44cc-8a6d-afcf3b86750b tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] Calling method '.version_select at 0x7fb21501fd30>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:31.515284 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.wsgi [None req-a2aae33c-cced-44cc-8a6d-afcf3b86750b tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] HTTP exception thrown: Volume d274e87a-cc3a-445a-a5e6-fb2f779ba527 could not be found. Aug 18 14:51:31.517635 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-a2aae33c-cced-44cc-8a6d-afcf3b86750b tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] Request method failure captured: Aug 18 14:51:31.517635 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: request: GET /compute/v2.1/os-volumes/d274e87a-cc3a-445a-a5e6-fb2f779ba527 HTTP/1.1 Aug 18 14:51:31.517635 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept: application/json Aug 18 14:51:31.517635 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept-Encoding: identity Aug 18 14:51:31.517635 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Connection: close Aug 18 14:51:31.517635 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Length: 0 Aug 18 14:51:31.517635 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Type: application/json Aug 18 14:51:31.517635 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Host: 10.222.0.36 Aug 18 14:51:31.517635 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Openstack-System-Scope: None Aug 18 14:51:31.517635 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: User-Agent: python-urllib3/1.26.11 Aug 18 14:51:31.517635 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Auth-Token: gAAAAABi_lHmmwhy7GZ4RALlChNUHI_z9_CR9od8_QaQip35cZkMjbv-eIg75ZZh4aibJriQ2zM2jvw5-dTv13BekxN70ZGGaeO5Y8LXYyVklo9_JPqYGO34bbERbQ3V3EOZRWjswadqwaRfKTDet84xv_H8XGnBY_NF5bxVgm9roa_X_ksVMoc Aug 18 14:51:31.517635 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Id: None Aug 18 14:51:31.517635 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Name: None Aug 18 14:51:31.517635 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Identity-Status: Confirmed Aug 18 14:51:31.517635 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Is-Admin-Project: True Aug 18 14:51:31.517635 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Id: default Aug 18 14:51:31.517635 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Name: Default Aug 18 14:51:31.517635 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Id: aded651ca7894034b7495f2fc3d58f51 Aug 18 14:51:31.517635 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-288793550 Aug 18 14:51:31.517635 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Role: reader,member Aug 18 14:51:31.517635 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Roles: reader,member Aug 18 14:51:31.518824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aded651ca7894034b7495f2fc3d58f51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aded651ca7894034b7495f2fc3d58f51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_aded651ca7894034b7495f2fc3d58f51", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/aded651ca7894034b7495f2fc3d58f51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:51:31.518824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant: tempest-VolumesSnapshotsTestJSON-288793550 Aug 18 14:51:31.518824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Id: aded651ca7894034b7495f2fc3d58f51 Aug 18 14:51:31.518824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-288793550 Aug 18 14:51:31.518824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User: tempest-VolumesSnapshotsTestJSON-288793550-project Aug 18 14:51:31.518824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Id: default Aug 18 14:51:31.518824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Name: Default Aug 18 14:51:31.518824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Id: ad318bf4dd64445496bd87d0bd64f3e2 Aug 18 14:51:31.518824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Name: tempest-VolumesSnapshotsTestJSON-288793550-project Aug 18 14:51:31.518824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: method: Aug 18 14:51:31.518824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: exception: Volume d274e87a-cc3a-445a-a5e6-fb2f779ba527 could not be found. Aug 18 14:51:31.518824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: action_args: {'id': 'd274e87a-cc3a-445a-a5e6-fb2f779ba527'} Aug 18 14:51:31.518824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:51:31.519501 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:31.519501 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:51:31.519501 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:51:31.519501 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 14:51:31.519501 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 14:51:31.519501 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 14:51:31.519501 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 14:51:31.519501 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 14:51:31.519501 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 14:51:31.519501 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 14:51:31.519501 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 14:51:31.519501 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:51:31.519501 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:51:31.519501 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:51:31.519501 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:51:31.519501 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d274e87a-cc3a-445a-a5e6-fb2f779ba527 could not be found. (HTTP 404) (Request-ID: req-f7e0a96e-6147-43d5-9a9d-9e77214c4494) Aug 18 14:51:31.519501 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:31.519501 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:51:31.519501 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:31.520508 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:31.520508 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 14:51:31.520508 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 14:51:31.520508 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 14:51:31.520508 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 14:51:31.520508 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 14:51:31.520508 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 14:51:31.520508 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 14:51:31.520508 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 14:51:31.520508 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:51:31.520508 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:51:31.520508 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 14:51:31.520508 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 14:51:31.520508 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 14:51:31.520508 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 14:51:31.520508 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 14:51:31.520508 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 14:51:31.520508 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 14:51:31.520508 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 14:51:31.521401 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:51:31.521401 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:51:31.521401 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:51:31.521401 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:51:31.521401 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d274e87a-cc3a-445a-a5e6-fb2f779ba527 could not be found. Aug 18 14:51:31.521401 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:31.521401 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:51:31.521401 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:31.521401 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:31.521401 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:51:31.521401 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:51:31.521401 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:51:31.521401 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:51:31.521401 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 14:51:31.521401 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 14:51:31.521401 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:51:31.521401 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:51:31.521401 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 14:51:31.521401 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:51:31.522754 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d274e87a-cc3a-445a-a5e6-fb2f779ba527 could not be found. Aug 18 14:51:31.522754 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:31.522754 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:51:31.522754 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:31.522754 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:51:31.522754 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:51:31.522754 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:51:31.522754 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:51:31.522754 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:51:31.522754 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d274e87a-cc3a-445a-a5e6-fb2f779ba527 could not be found. Aug 18 14:51:31.522754 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:51:31.524338 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-a2aae33c-cced-44cc-8a6d-afcf3b86750b tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] Returning 404 to user: Volume d274e87a-cc3a-445a-a5e6-fb2f779ba527 could not be found. {{(pid=132267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:51:31.525327 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-a2aae33c-cced-44cc-8a6d-afcf3b86750b tempest-VolumesSnapshotsTestJSON-288793550 tempest-VolumesSnapshotsTestJSON-288793550-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/d274e87a-cc3a-445a-a5e6-fb2f779ba527" status: 404 len: 109 microversion: 2.1 time: 0.142574 Aug 18 14:51:31.526231 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 30/39] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Aug 18 14:51:31 2022] GET /compute/v2.1/os-volumes/d274e87a-cc3a-445a-a5e6-fb2f779ba527 => generated 109 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:51:31.703086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-5d28c080-78a1-4994-aa56-fecdf2beda26 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:31.753405 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-5d28c080-78a1-4994-aa56-fecdf2beda26 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1214 microversion: 2.1 time: 0.349557 Aug 18 14:51:31.773689 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 10/40] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:31 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1214 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:51:32.788780 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-7e246e7b-ecac-40c1-80c6-5ff2d8902f42 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:32.791296 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-7e246e7b-ecac-40c1-80c6-5ff2d8902f42 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:33.801654 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-7e246e7b-ecac-40c1-80c6-5ff2d8902f42 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:33.846645 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-7e246e7b-ecac-40c1-80c6-5ff2d8902f42 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1214 microversion: 2.1 time: 1.061106 Aug 18 14:51:33.847930 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 31/41] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:32 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1214 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:34.869670 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-649592b1-fb82-4fdc-921e-5402930b2385 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:34.876466 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-649592b1-fb82-4fdc-921e-5402930b2385 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:34.907159 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-649592b1-fb82-4fdc-921e-5402930b2385 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:34.914752 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-649592b1-fb82-4fdc-921e-5402930b2385 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:34.915364 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-649592b1-fb82-4fdc-921e-5402930b2385 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:34.928781 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-649592b1-fb82-4fdc-921e-5402930b2385 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:34.929284 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-649592b1-fb82-4fdc-921e-5402930b2385 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:34.929734 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-649592b1-fb82-4fdc-921e-5402930b2385 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:35.624653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-649592b1-fb82-4fdc-921e-5402930b2385 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:35.659455 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-649592b1-fb82-4fdc-921e-5402930b2385 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1210 microversion: 2.1 time: 0.793606 Aug 18 14:51:35.674505 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 11/42] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:34 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1210 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:36.682684 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-da0b9b8a-3cae-4890-a66f-38f8ad9124c1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:36.684796 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-da0b9b8a-3cae-4890-a66f-38f8ad9124c1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:36.708988 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-da0b9b8a-3cae-4890-a66f-38f8ad9124c1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:36.710133 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-da0b9b8a-3cae-4890-a66f-38f8ad9124c1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:36.715959 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-da0b9b8a-3cae-4890-a66f-38f8ad9124c1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:36.722476 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-da0b9b8a-3cae-4890-a66f-38f8ad9124c1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:36.722983 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-da0b9b8a-3cae-4890-a66f-38f8ad9124c1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:36.723432 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-da0b9b8a-3cae-4890-a66f-38f8ad9124c1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:37.609183 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-da0b9b8a-3cae-4890-a66f-38f8ad9124c1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:37.690054 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-da0b9b8a-3cae-4890-a66f-38f8ad9124c1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1272 microversion: 2.1 time: 1.012959 Aug 18 14:51:37.692654 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 32/43] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:36 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1272 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:37.970658 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0ad41ac8-6a24-4972-903d-dc21d997792f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Action: 'create', calling method: .version_select at 0x7fb2146c3d30>, body: {"keypair": {"name": "tempest-keypair-390130781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+/t7RYpo5Qq/aLun25ZClc7aTyQNasOfe3/VqXUrL76IjM3zPLQr97dhDU8Uw+aYK0eqhgEnfl4x67IiH/7m6rE508AaRiK7iQF0cHprPqiQz12V6PcJGCiDonekjuWA=="}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:51:38.014129 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-0ad41ac8-6a24-4972-903d-dc21d997792f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Getting quotas for project 55c9fe0cbbfa47bca81668c039afc092. Resources: {'key_pairs'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:51:38.021150 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-0ad41ac8-6a24-4972-903d-dc21d997792f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Getting quotas for user 36dbc938bcd741f2a2b2013b6aa6f008 and project 55c9fe0cbbfa47bca81668c039afc092. Resources: {'key_pairs'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:51:38.186970 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0ad41ac8-6a24-4972-903d-dc21d997792f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.335820 Aug 18 14:51:38.192617 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 12/44] 10.222.0.36 () {60 vars in 1159 bytes} [Thu Aug 18 14:51:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:51:38.716132 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-a4b4afcb-ddd3-49f0-b14d-a6f92b7ce790 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:38.717107 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-a4b4afcb-ddd3-49f0-b14d-a6f92b7ce790 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:38.741739 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a4b4afcb-ddd3-49f0-b14d-a6f92b7ce790 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:38.747851 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a4b4afcb-ddd3-49f0-b14d-a6f92b7ce790 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:38.749602 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a4b4afcb-ddd3-49f0-b14d-a6f92b7ce790 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:38.758351 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a4b4afcb-ddd3-49f0-b14d-a6f92b7ce790 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:38.761495 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a4b4afcb-ddd3-49f0-b14d-a6f92b7ce790 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:38.763191 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a4b4afcb-ddd3-49f0-b14d-a6f92b7ce790 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:39.667315 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-a4b4afcb-ddd3-49f0-b14d-a6f92b7ce790 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:39.677838 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-a4b4afcb-ddd3-49f0-b14d-a6f92b7ce790 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1314 microversion: 2.1 time: 0.968397 Aug 18 14:51:39.739794 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 33/45] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:38 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1314 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:40.271721 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-547eb7d9-c189-4ae4-89bb-7c514d351646 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Action: 'create', calling method: .version_select at 0x7fb2147533a0>, body: {"keypair": {"name": "tempest-keypair-508715999", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoxCmK7pWBMfsHnXgc5uFQKMTmu0s1e/kKWkDp8NR5iYj2WoqhHPwoMRzAO9svzcft9xkXJOmbijsyvSVo61MJ4V56VQOmDNajzKud5iI16CREmhuunDoWJH7qxm7Amrw=="}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:51:40.357597 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-547eb7d9-c189-4ae4-89bb-7c514d351646 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Getting quotas for project bde4e338430442449fcc203cd9493bc3. Resources: {'key_pairs'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:51:40.384472 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-547eb7d9-c189-4ae4-89bb-7c514d351646 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Getting quotas for user 4d96208474754b2381d769d807689bbb and project bde4e338430442449fcc203cd9493bc3. Resources: {'key_pairs'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:51:40.425644 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-293a7ed3-d015-4107-86f9-fd7d7e1a9ee9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Action: 'create', calling method: .version_select at 0x7fb2150148b0>, body: {"keypair": {"name": "tempest-keypair-169930311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqCDRBznUgvIynCzQFoWYYShQGyP2OziEmSgags+jCPco9jQu+v0Lph2lIR77B21aqyQa3ANiuvVBFgGm1kAAXf19NpuRwTsjtfEywF2mw8t1OIsa6tCsTLfIpjhyTg3w=="}} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:51:40.521919 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-547eb7d9-c189-4ae4-89bb-7c514d351646 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.475790 Aug 18 14:51:40.522549 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 13/46] 10.222.0.36 () {60 vars in 1159 bytes} [Thu Aug 18 14:51:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:51:40.706831 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a131e0fa-42fc-4818-a79a-936c48fbef17 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:40.707622 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a131e0fa-42fc-4818-a79a-936c48fbef17 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:40.709151 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.quota [None req-293a7ed3-d015-4107-86f9-fd7d7e1a9ee9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Getting quotas for project 594f04dadf2a45fcb5fe2a80744cb9e6. Resources: {'key_pairs'} {{(pid=132267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:51:40.724448 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a131e0fa-42fc-4818-a79a-936c48fbef17 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:40.725633 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a131e0fa-42fc-4818-a79a-936c48fbef17 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:40.727089 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a131e0fa-42fc-4818-a79a-936c48fbef17 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:40.733949 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a131e0fa-42fc-4818-a79a-936c48fbef17 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:40.735660 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a131e0fa-42fc-4818-a79a-936c48fbef17 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:40.736995 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a131e0fa-42fc-4818-a79a-936c48fbef17 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:40.761681 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.quota [None req-293a7ed3-d015-4107-86f9-fd7d7e1a9ee9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Getting quotas for user 09b055bb15ce4b2ab4276b0090e16122 and project 594f04dadf2a45fcb5fe2a80744cb9e6. Resources: {'key_pairs'} {{(pid=132267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:51:40.979444 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-293a7ed3-d015-4107-86f9-fd7d7e1a9ee9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.164641 Aug 18 14:51:40.983290 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 34/47] 10.222.0.36 () {62 vars in 1200 bytes} [Thu Aug 18 14:51:39 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1172 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 18 14:51:41.060383 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=2 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:51:41.282751 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a131e0fa-42fc-4818-a79a-936c48fbef17 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:41.326683 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a131e0fa-42fc-4818-a79a-936c48fbef17 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1314 microversion: 2.1 time: 0.625098 Aug 18 14:51:41.327466 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 14/48] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:40 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1314 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:42.352948 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-65f09bf9-9393-4bae-9ecd-b765a5fe7123 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:42.354110 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-65f09bf9-9393-4bae-9ecd-b765a5fe7123 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:42.377273 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-65f09bf9-9393-4bae-9ecd-b765a5fe7123 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:42.387011 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-65f09bf9-9393-4bae-9ecd-b765a5fe7123 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:42.389795 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-65f09bf9-9393-4bae-9ecd-b765a5fe7123 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:42.397556 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-65f09bf9-9393-4bae-9ecd-b765a5fe7123 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:42.400528 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-65f09bf9-9393-4bae-9ecd-b765a5fe7123 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:42.404344 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-65f09bf9-9393-4bae-9ecd-b765a5fe7123 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:43.181301 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-65f09bf9-9393-4bae-9ecd-b765a5fe7123 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:43.197192 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-65f09bf9-9393-4bae-9ecd-b765a5fe7123 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1314 microversion: 2.1 time: 0.849566 Aug 18 14:51:43.203545 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 35/49] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:42 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1314 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:44.245085 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-db33d268-343e-4e98-8bb2-102fc13e78b7 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:44.246520 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-db33d268-343e-4e98-8bb2-102fc13e78b7 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:44.260882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-db33d268-343e-4e98-8bb2-102fc13e78b7 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:44.271880 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-db33d268-343e-4e98-8bb2-102fc13e78b7 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:44.277822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-db33d268-343e-4e98-8bb2-102fc13e78b7 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:44.279208 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-db33d268-343e-4e98-8bb2-102fc13e78b7 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:44.281118 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-db33d268-343e-4e98-8bb2-102fc13e78b7 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:44.286869 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-db33d268-343e-4e98-8bb2-102fc13e78b7 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:46.647977 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-8fd120cb-57ba-4f59-84d1-57f362b29a3a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1603375174", "imageRef": "4083d76b-6b95-4ed8-8053-69a1270afbd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93c9a460-c99c-4e1d-ba82-dd7168d9fd6a"}], "security_groups": [{"name": "tempest-securitygroup--1348730076"}], "key_name": "tempest-keypair-390130781", "user_data": "}} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:51:46.799727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-db33d268-343e-4e98-8bb2-102fc13e78b7 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:46.836840 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-db33d268-343e-4e98-8bb2-102fc13e78b7 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1314 microversion: 2.1 time: 2.596428 Aug 18 14:51:46.840564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 15/50] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:44 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1314 bytes in 2602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:47.738300 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.network.neutron [None req-8fd120cb-57ba-4f59-84d1-57f362b29a3a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] validate_networks() for [('93c9a460-c99c-4e1d-ba82-dd7168d9fd6a', None, None, None, None, None)] {{(pid=132267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:51:48.053640 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-30620b92-d297-4308-9887-2b646207ca88 req-a5357201-f69f-4df6-830c-7ab5cb2e8885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aa2e996-a18b-49a2-8456-afb00be537d4", "tag": "bfa6223e-f2cb-4716-b5bd-450125b52439"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:51:48.178370 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-30620b92-d297-4308-9887-2b646207ca88 req-a5357201-f69f-4df6-830c-7ab5cb2e8885 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:48.179297 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-30620b92-d297-4308-9887-2b646207ca88 req-a5357201-f69f-4df6-830c-7ab5cb2e8885 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:48.180169 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-30620b92-d297-4308-9887-2b646207ca88 req-a5357201-f69f-4df6-830c-7ab5cb2e8885 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:48.209856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-30620b92-d297-4308-9887-2b646207ca88 req-a5357201-f69f-4df6-830c-7ab5cb2e8885 service nova] Creating event network-changed:bfa6223e-f2cb-4716-b5bd-450125b52439 for instance 5aa2e996-a18b-49a2-8456-afb00be537d4 on hv-cinder-85220 Aug 18 14:51:48.210554 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-30620b92-d297-4308-9887-2b646207ca88 req-a5357201-f69f-4df6-830c-7ab5cb2e8885 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132268) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 14:51:48.210964 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-30620b92-d297-4308-9887-2b646207ca88 req-a5357201-f69f-4df6-830c-7ab5cb2e8885 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132268) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 14:51:48.212639 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0b5e759f-aa20-4a76-9143-8ae653ec9c08 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:48.213216 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0b5e759f-aa20-4a76-9143-8ae653ec9c08 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:48.214396 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0b5e759f-aa20-4a76-9143-8ae653ec9c08 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:48.215294 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0b5e759f-aa20-4a76-9143-8ae653ec9c08 None None] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:48.215994 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0b5e759f-aa20-4a76-9143-8ae653ec9c08 None None] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:48.216653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0b5e759f-aa20-4a76-9143-8ae653ec9c08 None None] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:48.232994 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.compute.rpcapi [None req-0b5e759f-aa20-4a76-9143-8ae653ec9c08 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 18 14:51:48.235188 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0b5e759f-aa20-4a76-9143-8ae653ec9c08 None None] Releasing lock "compute-rpcapi-router" {{(pid=132268) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 14:51:48.260620 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0b5e759f-aa20-4a76-9143-8ae653ec9c08 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.457073 Aug 18 14:51:48.261602 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 16/51] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:51:48.271668 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5d547c6f-5d12-440f-b8ba-6831d2cc9200 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:48.273175 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-5d547c6f-5d12-440f-b8ba-6831d2cc9200 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:48.285683 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5d547c6f-5d12-440f-b8ba-6831d2cc9200 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:48.286548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5d547c6f-5d12-440f-b8ba-6831d2cc9200 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:48.287337 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5d547c6f-5d12-440f-b8ba-6831d2cc9200 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:48.288724 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5d547c6f-5d12-440f-b8ba-6831d2cc9200 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:48.289548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5d547c6f-5d12-440f-b8ba-6831d2cc9200 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:48.290305 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5d547c6f-5d12-440f-b8ba-6831d2cc9200 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:48.725303 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-5d547c6f-5d12-440f-b8ba-6831d2cc9200 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:48.746910 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-5d547c6f-5d12-440f-b8ba-6831d2cc9200 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1314 microversion: 2.1 time: 0.483049 Aug 18 14:51:48.757117 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 17/52] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:48 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:49.124681 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ae1a56cb-458c-4dd8-8853-648a14a46220 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-787017208", "imageRef": "4083d76b-6b95-4ed8-8053-69a1270afbd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b4322c5-3837-461a-95c5-d4672de016b3"}], "security_groups": [{"name": "tempest-securitygroup--1092311458"}], "key_name": "tempest-keypair-508715999", "user_data": "}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:51:49.146669 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=5 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:51:49.595828 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.virt.hardware [None req-8fd120cb-57ba-4f59-84d1-57f362b29a3a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Flavor limits 0:0:0 {{(pid=132267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:51:49.599466 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.virt.hardware [None req-8fd120cb-57ba-4f59-84d1-57f362b29a3a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Image limits 0:0:0 {{(pid=132267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:51:49.600330 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.virt.hardware [None req-8fd120cb-57ba-4f59-84d1-57f362b29a3a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Flavor pref 0:0:0 {{(pid=132267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:51:49.600908 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.virt.hardware [None req-8fd120cb-57ba-4f59-84d1-57f362b29a3a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Image pref 0:0:0 {{(pid=132267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:51:49.601615 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.virt.hardware [None req-8fd120cb-57ba-4f59-84d1-57f362b29a3a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:51:49.633718 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8fd120cb-57ba-4f59-84d1-57f362b29a3a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:49.636375 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8fd120cb-57ba-4f59-84d1-57f362b29a3a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:49.637585 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8fd120cb-57ba-4f59-84d1-57f362b29a3a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:49.638924 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8fd120cb-57ba-4f59-84d1-57f362b29a3a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:49.639996 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8fd120cb-57ba-4f59-84d1-57f362b29a3a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:49.640955 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8fd120cb-57ba-4f59-84d1-57f362b29a3a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:49.694691 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.network.neutron [None req-ae1a56cb-458c-4dd8-8853-648a14a46220 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] validate_networks() for [('7b4322c5-3837-461a-95c5-d4672de016b3', None, None, None, None, None)] {{(pid=132268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:51:49.697011 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.quota [None req-8fd120cb-57ba-4f59-84d1-57f362b29a3a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Getting quotas for project 55c9fe0cbbfa47bca81668c039afc092. Resources: {'ram', 'instances', 'cores'} {{(pid=132267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:51:49.712417 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.quota [None req-8fd120cb-57ba-4f59-84d1-57f362b29a3a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Getting quotas for user 36dbc938bcd741f2a2b2013b6aa6f008 and project 55c9fe0cbbfa47bca81668c039afc092. Resources: {'ram', 'instances', 'cores'} {{(pid=132267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:51:49.744377 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-8fd120cb-57ba-4f59-84d1-57f362b29a3a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Going to run 1 instances... {{(pid=132267) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:51:49.751925 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-8fd120cb-57ba-4f59-84d1-57f362b29a3a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4083d76b-6b95-4ed8-8053-69a1270afbd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:51:49.911456 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-8fd120cb-57ba-4f59-84d1-57f362b29a3a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.265123 Aug 18 14:51:49.914625 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 36/53] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Aug 18 14:51:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 3273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:51:49.924609 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-eea68d2d-a519-4137-a55a-cc79072e22bc tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:49.925688 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-eea68d2d-a519-4137-a55a-cc79072e22bc tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:49.937175 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-eea68d2d-a519-4137-a55a-cc79072e22bc tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:49.938006 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-eea68d2d-a519-4137-a55a-cc79072e22bc tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:49.938735 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-eea68d2d-a519-4137-a55a-cc79072e22bc tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:49.939594 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-eea68d2d-a519-4137-a55a-cc79072e22bc tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:49.940451 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-eea68d2d-a519-4137-a55a-cc79072e22bc tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:49.941032 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-eea68d2d-a519-4137-a55a-cc79072e22bc tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:50.270292 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-eea68d2d-a519-4137-a55a-cc79072e22bc tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:50.285142 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-eea68d2d-a519-4137-a55a-cc79072e22bc tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1314 microversion: 2.1 time: 0.368723 Aug 18 14:51:50.286073 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 37/54] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:49 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:50.293492 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-bec06934-e12b-4284-b2b7-70ab7c0ded3b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:50.296601 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-bec06934-e12b-4284-b2b7-70ab7c0ded3b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:50.421526 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=16 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:51:50.703900 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-bec06934-e12b-4284-b2b7-70ab7c0ded3b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:50.736954 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-bec06934-e12b-4284-b2b7-70ab7c0ded3b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1241 microversion: 2.1 time: 0.449109 Aug 18 14:51:50.745349 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 38/55] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:50 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1241 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:50.821664 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-9aafe2b3-5081-4f49-a000-c8a48897f6f3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1876886407", "imageRef": "4083d76b-6b95-4ed8-8053-69a1270afbd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d06301d-eea8-481d-acc6-eaa13b822797"}], "security_groups": [{"name": "tempest-securitygroup--1925435766"}], "key_name": "tempest-keypair-169930311", "user_data": "}} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:51:51.311491 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.network.neutron [None req-9aafe2b3-5081-4f49-a000-c8a48897f6f3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] validate_networks() for [('6d06301d-eea8-481d-acc6-eaa13b822797', None, None, None, None, None)] {{(pid=132267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:51:51.403478 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-ae1a56cb-458c-4dd8-8853-648a14a46220 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Flavor limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:51:51.408582 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-ae1a56cb-458c-4dd8-8853-648a14a46220 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Image limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:51:51.409571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-ae1a56cb-458c-4dd8-8853-648a14a46220 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Flavor pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:51:51.412043 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-ae1a56cb-458c-4dd8-8853-648a14a46220 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Image pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:51:51.412622 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-ae1a56cb-458c-4dd8-8853-648a14a46220 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:51:51.440484 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ae1a56cb-458c-4dd8-8853-648a14a46220 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:51.441853 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ae1a56cb-458c-4dd8-8853-648a14a46220 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:51.449190 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ae1a56cb-458c-4dd8-8853-648a14a46220 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:51.450663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ae1a56cb-458c-4dd8-8853-648a14a46220 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:51.451445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ae1a56cb-458c-4dd8-8853-648a14a46220 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:51.476712 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ae1a56cb-458c-4dd8-8853-648a14a46220 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:51.568602 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-ae1a56cb-458c-4dd8-8853-648a14a46220 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Getting quotas for project bde4e338430442449fcc203cd9493bc3. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:51:51.583654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-ae1a56cb-458c-4dd8-8853-648a14a46220 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Getting quotas for user 4d96208474754b2381d769d807689bbb and project bde4e338430442449fcc203cd9493bc3. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:51:51.629461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ae1a56cb-458c-4dd8-8853-648a14a46220 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Going to run 1 instances... {{(pid=132268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:51:51.641043 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ae1a56cb-458c-4dd8-8853-648a14a46220 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4083d76b-6b95-4ed8-8053-69a1270afbd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:51:51.798247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-ae1a56cb-458c-4dd8-8853-648a14a46220 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.680108 Aug 18 14:51:51.809908 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 18/56] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Aug 18 14:51:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 2692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:51:51.817083 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-43d38457-f008-4300-8289-28a2b43f33f3 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:51.817948 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-43d38457-f008-4300-8289-28a2b43f33f3 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:51.829213 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-43d38457-f008-4300-8289-28a2b43f33f3 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:51.830249 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-43d38457-f008-4300-8289-28a2b43f33f3 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:51.830983 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-43d38457-f008-4300-8289-28a2b43f33f3 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:51.832137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-43d38457-f008-4300-8289-28a2b43f33f3 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:51.832783 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-43d38457-f008-4300-8289-28a2b43f33f3 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:51.833437 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-43d38457-f008-4300-8289-28a2b43f33f3 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:52.923237 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-43d38457-f008-4300-8289-28a2b43f33f3 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:52.966156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-43d38457-f008-4300-8289-28a2b43f33f3 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1314 microversion: 2.1 time: 1.137501 Aug 18 14:51:52.979717 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 19/57] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:51 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1314 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:53.004315 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2fb27911-1cfe-4c7a-8989-0725b613718b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:53.008718 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2fb27911-1cfe-4c7a-8989-0725b613718b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:53.042933 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2fb27911-1cfe-4c7a-8989-0725b613718b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:53.044179 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2fb27911-1cfe-4c7a-8989-0725b613718b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:53.046381 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2fb27911-1cfe-4c7a-8989-0725b613718b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:53.051357 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2fb27911-1cfe-4c7a-8989-0725b613718b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:53.055923 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2fb27911-1cfe-4c7a-8989-0725b613718b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:53.056519 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2fb27911-1cfe-4c7a-8989-0725b613718b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:53.345054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2fb27911-1cfe-4c7a-8989-0725b613718b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:53.364906 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.virt.hardware [None req-9aafe2b3-5081-4f49-a000-c8a48897f6f3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Flavor limits 0:0:0 {{(pid=132267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:51:53.365488 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.virt.hardware [None req-9aafe2b3-5081-4f49-a000-c8a48897f6f3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Image limits 0:0:0 {{(pid=132267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:51:53.365803 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.virt.hardware [None req-9aafe2b3-5081-4f49-a000-c8a48897f6f3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Flavor pref 0:0:0 {{(pid=132267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:51:53.366220 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.virt.hardware [None req-9aafe2b3-5081-4f49-a000-c8a48897f6f3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Image pref 0:0:0 {{(pid=132267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:51:53.366660 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.virt.hardware [None req-9aafe2b3-5081-4f49-a000-c8a48897f6f3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:51:53.370713 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2fb27911-1cfe-4c7a-8989-0725b613718b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1293 microversion: 2.1 time: 0.388489 Aug 18 14:51:53.377038 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 20/58] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:52 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1293 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:53.391433 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9aafe2b3-5081-4f49-a000-c8a48897f6f3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:53.394348 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9aafe2b3-5081-4f49-a000-c8a48897f6f3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:53.395644 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9aafe2b3-5081-4f49-a000-c8a48897f6f3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:53.396221 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-fc025090-bddd-4e91-ab60-1b830f0ab827 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:53.397514 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9aafe2b3-5081-4f49-a000-c8a48897f6f3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:53.398403 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-fc025090-bddd-4e91-ab60-1b830f0ab827 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:53.402977 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9aafe2b3-5081-4f49-a000-c8a48897f6f3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:53.405575 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9aafe2b3-5081-4f49-a000-c8a48897f6f3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:53.420286 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fc025090-bddd-4e91-ab60-1b830f0ab827 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:53.420810 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fc025090-bddd-4e91-ab60-1b830f0ab827 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:53.421250 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fc025090-bddd-4e91-ab60-1b830f0ab827 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:53.428531 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fc025090-bddd-4e91-ab60-1b830f0ab827 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:53.431352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fc025090-bddd-4e91-ab60-1b830f0ab827 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:53.433801 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fc025090-bddd-4e91-ab60-1b830f0ab827 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:53.475823 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.quota [None req-9aafe2b3-5081-4f49-a000-c8a48897f6f3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Getting quotas for project 594f04dadf2a45fcb5fe2a80744cb9e6. Resources: {'ram', 'instances', 'cores'} {{(pid=132267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:51:53.486904 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.quota [None req-9aafe2b3-5081-4f49-a000-c8a48897f6f3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Getting quotas for user 09b055bb15ce4b2ab4276b0090e16122 and project 594f04dadf2a45fcb5fe2a80744cb9e6. Resources: {'ram', 'instances', 'cores'} {{(pid=132267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:51:53.519476 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-9aafe2b3-5081-4f49-a000-c8a48897f6f3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Going to run 1 instances... {{(pid=132267) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:51:53.521741 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-9aafe2b3-5081-4f49-a000-c8a48897f6f3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4083d76b-6b95-4ed8-8053-69a1270afbd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:51:53.596314 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-9aafe2b3-5081-4f49-a000-c8a48897f6f3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.847976 Aug 18 14:51:53.596974 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 39/59] 10.222.0.36 () {62 vars in 1188 bytes} [Thu Aug 18 14:51:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 2849 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 18 14:51:53.607008 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-fc025090-bddd-4e91-ab60-1b830f0ab827 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:53.613497 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-04a0e898-b18e-4674-9a0c-b511f992427a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:53.614505 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-04a0e898-b18e-4674-9a0c-b511f992427a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:53.615880 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-fc025090-bddd-4e91-ab60-1b830f0ab827 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1240 microversion: 2.1 time: 0.237513 Aug 18 14:51:53.617909 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 21/60] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:53 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1240 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:53.684972 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-04a0e898-b18e-4674-9a0c-b511f992427a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:53.693845 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-04a0e898-b18e-4674-9a0c-b511f992427a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:53.695574 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-04a0e898-b18e-4674-9a0c-b511f992427a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:53.698107 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-04a0e898-b18e-4674-9a0c-b511f992427a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1281 microversion: 2.20 time: 0.091318 Aug 18 14:51:53.699232 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 40/61] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:51:53 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1281 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:51:54.006388 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-927e2014-8b15-4c78-ba3c-0e500256482e tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:54.007908 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-927e2014-8b15-4c78-ba3c-0e500256482e tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:54.018285 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-927e2014-8b15-4c78-ba3c-0e500256482e tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:54.018803 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-927e2014-8b15-4c78-ba3c-0e500256482e tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:54.019248 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-927e2014-8b15-4c78-ba3c-0e500256482e tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:54.019983 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-927e2014-8b15-4c78-ba3c-0e500256482e tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:54.020444 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-927e2014-8b15-4c78-ba3c-0e500256482e tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:54.020879 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-927e2014-8b15-4c78-ba3c-0e500256482e tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:54.203250 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-927e2014-8b15-4c78-ba3c-0e500256482e tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:54.213930 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-927e2014-8b15-4c78-ba3c-0e500256482e tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1314 microversion: 2.1 time: 0.222285 Aug 18 14:51:54.214688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 22/62] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:53 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:54.406561 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-4f30bc0f-2c41-4361-b315-757e71674660 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:54.407343 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-4f30bc0f-2c41-4361-b315-757e71674660 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:54.414589 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4f30bc0f-2c41-4361-b315-757e71674660 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:54.415671 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4f30bc0f-2c41-4361-b315-757e71674660 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:54.415671 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4f30bc0f-2c41-4361-b315-757e71674660 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:54.416269 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4f30bc0f-2c41-4361-b315-757e71674660 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:54.416727 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4f30bc0f-2c41-4361-b315-757e71674660 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:54.417150 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4f30bc0f-2c41-4361-b315-757e71674660 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:54.490222 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-4f30bc0f-2c41-4361-b315-757e71674660 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:54.498786 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-4f30bc0f-2c41-4361-b315-757e71674660 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1293 microversion: 2.1 time: 0.099704 Aug 18 14:51:54.499633 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 41/63] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:54 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1293 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:54.642515 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-983219aa-f7e3-4395-a938-24a317cb54d9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:54.643653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-983219aa-f7e3-4395-a938-24a317cb54d9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:54.650738 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-983219aa-f7e3-4395-a938-24a317cb54d9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:54.651625 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-983219aa-f7e3-4395-a938-24a317cb54d9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:54.652203 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-983219aa-f7e3-4395-a938-24a317cb54d9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:54.653107 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-983219aa-f7e3-4395-a938-24a317cb54d9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:54.653719 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-983219aa-f7e3-4395-a938-24a317cb54d9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:54.654199 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-983219aa-f7e3-4395-a938-24a317cb54d9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:54.722533 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-983219aa-f7e3-4395-a938-24a317cb54d9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:54.722751 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-6576561b-30e0-4682-9b77-45dd38c82cb1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:54.723647 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-6576561b-30e0-4682-9b77-45dd38c82cb1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:54.729794 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-6576561b-30e0-4682-9b77-45dd38c82cb1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:54.730282 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-6576561b-30e0-4682-9b77-45dd38c82cb1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:54.730785 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-6576561b-30e0-4682-9b77-45dd38c82cb1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:54.731515 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-6576561b-30e0-4682-9b77-45dd38c82cb1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:54.731871 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-983219aa-f7e3-4395-a938-24a317cb54d9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1240 microversion: 2.1 time: 0.093201 Aug 18 14:51:54.731991 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-6576561b-30e0-4682-9b77-45dd38c82cb1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:54.732288 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-6576561b-30e0-4682-9b77-45dd38c82cb1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:54.732717 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 23/64] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:54 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1240 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:54.794067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-6576561b-30e0-4682-9b77-45dd38c82cb1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:54.802415 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-6576561b-30e0-4682-9b77-45dd38c82cb1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:54.803982 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-6576561b-30e0-4682-9b77-45dd38c82cb1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:54.805077 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-6576561b-30e0-4682-9b77-45dd38c82cb1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1285 microversion: 2.20 time: 0.086641 Aug 18 14:51:54.805637 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 42/65] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:51:54 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:51:55.235397 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-6d369888-4070-42ba-9a80-03381e30358a tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:55.236059 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-6d369888-4070-42ba-9a80-03381e30358a tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:55.241963 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6d369888-4070-42ba-9a80-03381e30358a tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:55.242450 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6d369888-4070-42ba-9a80-03381e30358a tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:55.242887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6d369888-4070-42ba-9a80-03381e30358a tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:55.243605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6d369888-4070-42ba-9a80-03381e30358a tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:55.244136 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6d369888-4070-42ba-9a80-03381e30358a tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:55.244509 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6d369888-4070-42ba-9a80-03381e30358a tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:55.393952 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6d369888-4070-42ba-9a80-03381e30358a tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:55.402194 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-6d369888-4070-42ba-9a80-03381e30358a tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1314 microversion: 2.1 time: 0.170856 Aug 18 14:51:55.402773 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 24/66] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:55 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:55.529514 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-6b2c263d-f11a-44bf-8f30-7122b16091fe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:55.530126 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-6b2c263d-f11a-44bf-8f30-7122b16091fe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:55.536939 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-6b2c263d-f11a-44bf-8f30-7122b16091fe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:55.537422 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-6b2c263d-f11a-44bf-8f30-7122b16091fe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:55.537844 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-6b2c263d-f11a-44bf-8f30-7122b16091fe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:55.538530 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-6b2c263d-f11a-44bf-8f30-7122b16091fe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:55.538973 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-6b2c263d-f11a-44bf-8f30-7122b16091fe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:55.539389 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-6b2c263d-f11a-44bf-8f30-7122b16091fe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:55.608305 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-6b2c263d-f11a-44bf-8f30-7122b16091fe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:55.617091 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-6b2c263d-f11a-44bf-8f30-7122b16091fe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1293 microversion: 2.1 time: 0.092749 Aug 18 14:51:55.617989 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 43/67] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:55 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:55.755978 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-71196339-e1a1-4dc4-b163-b137c6ce7b3a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:55.757321 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-71196339-e1a1-4dc4-b163-b137c6ce7b3a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:55.767772 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-71196339-e1a1-4dc4-b163-b137c6ce7b3a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:55.768808 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-71196339-e1a1-4dc4-b163-b137c6ce7b3a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:55.769616 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-71196339-e1a1-4dc4-b163-b137c6ce7b3a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:55.770518 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-71196339-e1a1-4dc4-b163-b137c6ce7b3a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:55.771221 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-71196339-e1a1-4dc4-b163-b137c6ce7b3a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:55.771657 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-71196339-e1a1-4dc4-b163-b137c6ce7b3a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:55.827661 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-11db1145-0e44-4336-8085-8cc58fb47769 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:55.828367 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-11db1145-0e44-4336-8085-8cc58fb47769 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:55.831313 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-71196339-e1a1-4dc4-b163-b137c6ce7b3a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:55.834674 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-11db1145-0e44-4336-8085-8cc58fb47769 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:55.835235 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-11db1145-0e44-4336-8085-8cc58fb47769 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:55.835689 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-11db1145-0e44-4336-8085-8cc58fb47769 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:55.836400 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-11db1145-0e44-4336-8085-8cc58fb47769 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:55.836860 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-11db1145-0e44-4336-8085-8cc58fb47769 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:55.837287 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-11db1145-0e44-4336-8085-8cc58fb47769 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:55.839006 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-71196339-e1a1-4dc4-b163-b137c6ce7b3a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1240 microversion: 2.1 time: 0.089107 Aug 18 14:51:55.839746 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 25/68] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:55 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:55.915529 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-11db1145-0e44-4336-8085-8cc58fb47769 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:55.932108 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-11db1145-0e44-4336-8085-8cc58fb47769 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:55.934013 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-11db1145-0e44-4336-8085-8cc58fb47769 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:55.935381 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-11db1145-0e44-4336-8085-8cc58fb47769 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1285 microversion: 2.20 time: 0.111536 Aug 18 14:51:55.948567 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 44/69] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:51:55 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:51:56.423487 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2990fb9b-6088-4872-89a0-0b5d4897a104 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:56.424149 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2990fb9b-6088-4872-89a0-0b5d4897a104 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:56.431259 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2990fb9b-6088-4872-89a0-0b5d4897a104 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:56.432634 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2990fb9b-6088-4872-89a0-0b5d4897a104 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:56.433204 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2990fb9b-6088-4872-89a0-0b5d4897a104 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:56.433922 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2990fb9b-6088-4872-89a0-0b5d4897a104 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:56.434534 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2990fb9b-6088-4872-89a0-0b5d4897a104 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:56.434967 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2990fb9b-6088-4872-89a0-0b5d4897a104 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:56.578831 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2990fb9b-6088-4872-89a0-0b5d4897a104 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:56.587373 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2990fb9b-6088-4872-89a0-0b5d4897a104 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1314 microversion: 2.1 time: 0.167892 Aug 18 14:51:56.588215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 26/70] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:56 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:56.640063 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-1a9ad2d3-4224-4797-807b-958532b9e0d1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:56.640665 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-1a9ad2d3-4224-4797-807b-958532b9e0d1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:56.651466 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1a9ad2d3-4224-4797-807b-958532b9e0d1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:56.651991 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1a9ad2d3-4224-4797-807b-958532b9e0d1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:56.652423 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1a9ad2d3-4224-4797-807b-958532b9e0d1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:56.664026 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1a9ad2d3-4224-4797-807b-958532b9e0d1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:56.664518 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1a9ad2d3-4224-4797-807b-958532b9e0d1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:56.664953 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1a9ad2d3-4224-4797-807b-958532b9e0d1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:56.738647 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-1a9ad2d3-4224-4797-807b-958532b9e0d1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:56.746673 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-1a9ad2d3-4224-4797-807b-958532b9e0d1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1293 microversion: 2.1 time: 0.111225 Aug 18 14:51:56.747243 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 45/71] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:56 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1293 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:56.860198 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-cf48d6ed-197f-4910-b4d2-1e3532b40ab5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:56.860808 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-cf48d6ed-197f-4910-b4d2-1e3532b40ab5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:56.866843 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cf48d6ed-197f-4910-b4d2-1e3532b40ab5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:56.867332 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cf48d6ed-197f-4910-b4d2-1e3532b40ab5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:56.867789 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cf48d6ed-197f-4910-b4d2-1e3532b40ab5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:56.868490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cf48d6ed-197f-4910-b4d2-1e3532b40ab5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:56.868943 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cf48d6ed-197f-4910-b4d2-1e3532b40ab5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:56.869368 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cf48d6ed-197f-4910-b4d2-1e3532b40ab5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:56.937002 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-cf48d6ed-197f-4910-b4d2-1e3532b40ab5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:56.945828 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-cf48d6ed-197f-4910-b4d2-1e3532b40ab5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1240 microversion: 2.1 time: 0.089462 Aug 18 14:51:56.946788 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 27/72] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:56 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:56.961673 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-8a4e47d9-dbfd-446c-bd83-10dfb58a5f7f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:56.963419 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-8a4e47d9-dbfd-446c-bd83-10dfb58a5f7f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:56.974992 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8a4e47d9-dbfd-446c-bd83-10dfb58a5f7f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:56.975964 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8a4e47d9-dbfd-446c-bd83-10dfb58a5f7f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:56.976935 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8a4e47d9-dbfd-446c-bd83-10dfb58a5f7f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:56.978121 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8a4e47d9-dbfd-446c-bd83-10dfb58a5f7f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:56.979577 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8a4e47d9-dbfd-446c-bd83-10dfb58a5f7f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:56.980318 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8a4e47d9-dbfd-446c-bd83-10dfb58a5f7f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:57.060582 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-8a4e47d9-dbfd-446c-bd83-10dfb58a5f7f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:57.074513 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-8a4e47d9-dbfd-446c-bd83-10dfb58a5f7f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:57.077849 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-8a4e47d9-dbfd-446c-bd83-10dfb58a5f7f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:57.078793 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-8a4e47d9-dbfd-446c-bd83-10dfb58a5f7f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1285 microversion: 2.20 time: 0.122953 Aug 18 14:51:57.090673 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 46/73] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:51:56 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:51:57.608223 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-1007e3fb-b2b9-4172-9c01-8cff08a6fb51 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:57.608822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-1007e3fb-b2b9-4172-9c01-8cff08a6fb51 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:57.615351 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1007e3fb-b2b9-4172-9c01-8cff08a6fb51 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:57.615977 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1007e3fb-b2b9-4172-9c01-8cff08a6fb51 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:57.616406 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1007e3fb-b2b9-4172-9c01-8cff08a6fb51 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:57.617261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1007e3fb-b2b9-4172-9c01-8cff08a6fb51 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:57.617955 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1007e3fb-b2b9-4172-9c01-8cff08a6fb51 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:57.618564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1007e3fb-b2b9-4172-9c01-8cff08a6fb51 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:57.771447 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-6ca7c1ac-e6b4-4657-9b3f-a770e1499740 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:57.772132 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-6ca7c1ac-e6b4-4657-9b3f-a770e1499740 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:57.779509 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-6ca7c1ac-e6b4-4657-9b3f-a770e1499740 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:57.780230 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-6ca7c1ac-e6b4-4657-9b3f-a770e1499740 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:57.780665 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-6ca7c1ac-e6b4-4657-9b3f-a770e1499740 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:57.781533 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-6ca7c1ac-e6b4-4657-9b3f-a770e1499740 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:57.781822 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-6ca7c1ac-e6b4-4657-9b3f-a770e1499740 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:57.782241 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-6ca7c1ac-e6b4-4657-9b3f-a770e1499740 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:57.811768 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-1007e3fb-b2b9-4172-9c01-8cff08a6fb51 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:57.820523 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-1007e3fb-b2b9-4172-9c01-8cff08a6fb51 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1314 microversion: 2.1 time: 0.215977 Aug 18 14:51:57.831733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 28/74] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:57 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:57.850002 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-6ca7c1ac-e6b4-4657-9b3f-a770e1499740 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:57.858522 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-6ca7c1ac-e6b4-4657-9b3f-a770e1499740 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1293 microversion: 2.1 time: 0.090914 Aug 18 14:51:57.859091 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 47/75] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:57 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:51:57.967028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-9ae06577-abc6-4031-8e81-d10e42f21779 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:57.967647 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-9ae06577-abc6-4031-8e81-d10e42f21779 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:57.973696 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9ae06577-abc6-4031-8e81-d10e42f21779 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:57.974183 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9ae06577-abc6-4031-8e81-d10e42f21779 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:57.974623 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9ae06577-abc6-4031-8e81-d10e42f21779 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:57.975324 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9ae06577-abc6-4031-8e81-d10e42f21779 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:57.975822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9ae06577-abc6-4031-8e81-d10e42f21779 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:57.976247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9ae06577-abc6-4031-8e81-d10e42f21779 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:58.042350 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-9ae06577-abc6-4031-8e81-d10e42f21779 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:58.050077 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-9ae06577-abc6-4031-8e81-d10e42f21779 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1240 microversion: 2.1 time: 0.087455 Aug 18 14:51:58.050647 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 29/76] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:57 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:58.104697 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-5a31e7e4-4a7b-477f-a40e-9d3175d2f458 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:58.105329 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-5a31e7e4-4a7b-477f-a40e-9d3175d2f458 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:58.111348 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5a31e7e4-4a7b-477f-a40e-9d3175d2f458 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:58.111932 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5a31e7e4-4a7b-477f-a40e-9d3175d2f458 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:58.112364 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5a31e7e4-4a7b-477f-a40e-9d3175d2f458 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:58.113055 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5a31e7e4-4a7b-477f-a40e-9d3175d2f458 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:58.113502 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5a31e7e4-4a7b-477f-a40e-9d3175d2f458 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:58.113918 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5a31e7e4-4a7b-477f-a40e-9d3175d2f458 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:58.129219 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_cell1:SELECT=73 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:51:58.176757 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-5a31e7e4-4a7b-477f-a40e-9d3175d2f458 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:58.185399 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-5a31e7e4-4a7b-477f-a40e-9d3175d2f458 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:58.186898 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-5a31e7e4-4a7b-477f-a40e-9d3175d2f458 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:58.188058 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-5a31e7e4-4a7b-477f-a40e-9d3175d2f458 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1285 microversion: 2.20 time: 0.087238 Aug 18 14:51:58.188617 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 48/77] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:51:58 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:51:58.841981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ed80d96f-639b-42f4-b18f-001e61d1093b tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:58.842604 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ed80d96f-639b-42f4-b18f-001e61d1093b tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:58.848809 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ed80d96f-639b-42f4-b18f-001e61d1093b tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:58.849297 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ed80d96f-639b-42f4-b18f-001e61d1093b tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:58.849734 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ed80d96f-639b-42f4-b18f-001e61d1093b tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:58.850424 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ed80d96f-639b-42f4-b18f-001e61d1093b tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:58.850881 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ed80d96f-639b-42f4-b18f-001e61d1093b tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:58.851312 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ed80d96f-639b-42f4-b18f-001e61d1093b tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:58.854437 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=99 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:51:58.878875 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-33a0dd3f-0103-4c6c-ac18-ec5dc004f92f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:58.879515 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-33a0dd3f-0103-4c6c-ac18-ec5dc004f92f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:58.881455 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=7 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:51:58.887014 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-33a0dd3f-0103-4c6c-ac18-ec5dc004f92f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:58.887493 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-33a0dd3f-0103-4c6c-ac18-ec5dc004f92f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:58.887946 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-33a0dd3f-0103-4c6c-ac18-ec5dc004f92f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:58.888647 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-33a0dd3f-0103-4c6c-ac18-ec5dc004f92f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:58.889099 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-33a0dd3f-0103-4c6c-ac18-ec5dc004f92f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:58.889520 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-33a0dd3f-0103-4c6c-ac18-ec5dc004f92f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:58.971341 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-33a0dd3f-0103-4c6c-ac18-ec5dc004f92f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:58.979811 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-33a0dd3f-0103-4c6c-ac18-ec5dc004f92f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1293 microversion: 2.1 time: 0.104663 Aug 18 14:51:58.980373 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 49/78] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:58 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1293 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:51:59.007828 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ed80d96f-639b-42f4-b18f-001e61d1093b tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:59.015813 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-ed80d96f-639b-42f4-b18f-001e61d1093b tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1314 microversion: 2.1 time: 0.177700 Aug 18 14:51:59.016374 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 30/79] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:58 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:59.070224 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-488fcc91-8c22-4bdd-9be0-9a298317fca0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:59.070831 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-488fcc91-8c22-4bdd-9be0-9a298317fca0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:59.076763 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-488fcc91-8c22-4bdd-9be0-9a298317fca0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:59.077238 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-488fcc91-8c22-4bdd-9be0-9a298317fca0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:59.077669 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-488fcc91-8c22-4bdd-9be0-9a298317fca0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:59.078406 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-488fcc91-8c22-4bdd-9be0-9a298317fca0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:59.078853 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-488fcc91-8c22-4bdd-9be0-9a298317fca0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:59.079272 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-488fcc91-8c22-4bdd-9be0-9a298317fca0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:59.138667 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-488fcc91-8c22-4bdd-9be0-9a298317fca0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:59.146231 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-488fcc91-8c22-4bdd-9be0-9a298317fca0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1240 microversion: 2.1 time: 0.079794 Aug 18 14:51:59.146786 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 50/80] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:59 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1240 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:51:59.211052 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5759890e-10d5-417f-857c-0caa4678ca86 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:51:59.211663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-5759890e-10d5-417f-857c-0caa4678ca86 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:51:59.218250 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5759890e-10d5-417f-857c-0caa4678ca86 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:59.218763 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5759890e-10d5-417f-857c-0caa4678ca86 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:59.219196 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5759890e-10d5-417f-857c-0caa4678ca86 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:59.219911 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5759890e-10d5-417f-857c-0caa4678ca86 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:51:59.220358 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5759890e-10d5-417f-857c-0caa4678ca86 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:51:59.220777 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5759890e-10d5-417f-857c-0caa4678ca86 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:51:59.282890 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-5759890e-10d5-417f-857c-0caa4678ca86 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:59.291592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-5759890e-10d5-417f-857c-0caa4678ca86 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:59.293101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-5759890e-10d5-417f-857c-0caa4678ca86 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:51:59.294195 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-5759890e-10d5-417f-857c-0caa4678ca86 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1285 microversion: 2.20 time: 0.087096 Aug 18 14:51:59.294757 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 31/81] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:51:59 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:52:00.002590 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-f084720e-635f-449b-bdf8-f48a7db3ab19 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:00.003447 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-f084720e-635f-449b-bdf8-f48a7db3ab19 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:00.010330 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f084720e-635f-449b-bdf8-f48a7db3ab19 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:00.010885 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f084720e-635f-449b-bdf8-f48a7db3ab19 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:00.011318 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f084720e-635f-449b-bdf8-f48a7db3ab19 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:00.012034 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f084720e-635f-449b-bdf8-f48a7db3ab19 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:00.012483 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f084720e-635f-449b-bdf8-f48a7db3ab19 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:00.012900 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f084720e-635f-449b-bdf8-f48a7db3ab19 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:00.037540 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c921f981-71b5-4a1c-9f88-f9959f0c3fb1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:00.038068 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c921f981-71b5-4a1c-9f88-f9959f0c3fb1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:00.044271 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c921f981-71b5-4a1c-9f88-f9959f0c3fb1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:00.044763 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c921f981-71b5-4a1c-9f88-f9959f0c3fb1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:00.045201 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c921f981-71b5-4a1c-9f88-f9959f0c3fb1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:00.045907 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c921f981-71b5-4a1c-9f88-f9959f0c3fb1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:00.046360 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c921f981-71b5-4a1c-9f88-f9959f0c3fb1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:00.046781 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c921f981-71b5-4a1c-9f88-f9959f0c3fb1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:00.076276 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-f084720e-635f-449b-bdf8-f48a7db3ab19 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:00.083985 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-f084720e-635f-449b-bdf8-f48a7db3ab19 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1293 microversion: 2.1 time: 0.086422 Aug 18 14:52:00.084552 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 51/82] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:51:59 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:00.166796 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-18073888-c382-4fe0-86d0-92957aa79d42 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:00.167402 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-18073888-c382-4fe0-86d0-92957aa79d42 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:00.173433 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-18073888-c382-4fe0-86d0-92957aa79d42 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:00.173917 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-18073888-c382-4fe0-86d0-92957aa79d42 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:00.174637 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-18073888-c382-4fe0-86d0-92957aa79d42 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:00.175016 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-18073888-c382-4fe0-86d0-92957aa79d42 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:00.175461 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-18073888-c382-4fe0-86d0-92957aa79d42 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:00.175910 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-18073888-c382-4fe0-86d0-92957aa79d42 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:00.176624 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c921f981-71b5-4a1c-9f88-f9959f0c3fb1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:00.184969 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c921f981-71b5-4a1c-9f88-f9959f0c3fb1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1314 microversion: 2.1 time: 0.151340 Aug 18 14:52:00.185535 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 32/83] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:00 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:52:00.235895 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-18073888-c382-4fe0-86d0-92957aa79d42 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:00.243359 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-18073888-c382-4fe0-86d0-92957aa79d42 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1240 microversion: 2.1 time: 0.080934 Aug 18 14:52:00.244034 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 52/84] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:00 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1240 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:52:00.316116 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-99537922-2b6c-4fb3-a39b-7c616ceec5b4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:00.316725 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-99537922-2b6c-4fb3-a39b-7c616ceec5b4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:00.322657 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-99537922-2b6c-4fb3-a39b-7c616ceec5b4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:00.323127 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-99537922-2b6c-4fb3-a39b-7c616ceec5b4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:00.323552 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-99537922-2b6c-4fb3-a39b-7c616ceec5b4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:00.324263 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-99537922-2b6c-4fb3-a39b-7c616ceec5b4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:00.324704 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-99537922-2b6c-4fb3-a39b-7c616ceec5b4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:00.325122 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-99537922-2b6c-4fb3-a39b-7c616ceec5b4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:00.384290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-99537922-2b6c-4fb3-a39b-7c616ceec5b4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:00.392368 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-99537922-2b6c-4fb3-a39b-7c616ceec5b4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:00.393859 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-99537922-2b6c-4fb3-a39b-7c616ceec5b4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:00.394944 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-99537922-2b6c-4fb3-a39b-7c616ceec5b4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1277 microversion: 2.20 time: 0.082644 Aug 18 14:52:00.395488 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 33/85] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:00 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1277 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:52:01.104721 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-2aca3628-e201-4e70-8783-20b9cfad1c75 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:01.105321 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-2aca3628-e201-4e70-8783-20b9cfad1c75 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:01.111371 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2aca3628-e201-4e70-8783-20b9cfad1c75 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:01.111823 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2aca3628-e201-4e70-8783-20b9cfad1c75 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:01.112251 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2aca3628-e201-4e70-8783-20b9cfad1c75 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:01.112934 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2aca3628-e201-4e70-8783-20b9cfad1c75 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:01.113378 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2aca3628-e201-4e70-8783-20b9cfad1c75 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:01.113795 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2aca3628-e201-4e70-8783-20b9cfad1c75 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:01.179209 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-2aca3628-e201-4e70-8783-20b9cfad1c75 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:01.186887 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-2aca3628-e201-4e70-8783-20b9cfad1c75 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1293 microversion: 2.1 time: 0.086091 Aug 18 14:52:01.187611 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 53/86] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:01 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:01.205024 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-14f32a29-c8ac-424e-b66c-2edcd65cd9de tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:01.205659 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-14f32a29-c8ac-424e-b66c-2edcd65cd9de tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:01.211569 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-14f32a29-c8ac-424e-b66c-2edcd65cd9de tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:01.212084 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-14f32a29-c8ac-424e-b66c-2edcd65cd9de tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:01.212511 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-14f32a29-c8ac-424e-b66c-2edcd65cd9de tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:01.213191 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-14f32a29-c8ac-424e-b66c-2edcd65cd9de tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:01.213690 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-14f32a29-c8ac-424e-b66c-2edcd65cd9de tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:01.214637 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-14f32a29-c8ac-424e-b66c-2edcd65cd9de tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:01.265475 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-8bc1d52b-8a76-4589-b80b-fe2bd50ae660 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:01.266075 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-8bc1d52b-8a76-4589-b80b-fe2bd50ae660 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:01.272017 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8bc1d52b-8a76-4589-b80b-fe2bd50ae660 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:01.272495 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8bc1d52b-8a76-4589-b80b-fe2bd50ae660 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:01.272925 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8bc1d52b-8a76-4589-b80b-fe2bd50ae660 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:01.273616 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8bc1d52b-8a76-4589-b80b-fe2bd50ae660 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:01.274072 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8bc1d52b-8a76-4589-b80b-fe2bd50ae660 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:01.274489 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8bc1d52b-8a76-4589-b80b-fe2bd50ae660 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:01.348351 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-8bc1d52b-8a76-4589-b80b-fe2bd50ae660 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:01.358830 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-8bc1d52b-8a76-4589-b80b-fe2bd50ae660 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1240 microversion: 2.1 time: 0.097075 Aug 18 14:52:01.359399 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 54/87] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:01 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1240 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:52:01.373818 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-14f32a29-c8ac-424e-b66c-2edcd65cd9de tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:01.381883 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-14f32a29-c8ac-424e-b66c-2edcd65cd9de tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1314 microversion: 2.1 time: 0.180326 Aug 18 14:52:01.382459 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 34/88] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:01 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:01.417932 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-8232e672-5dd5-4fac-8a48-fbde70117603 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:01.418539 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-8232e672-5dd5-4fac-8a48-fbde70117603 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:01.424688 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8232e672-5dd5-4fac-8a48-fbde70117603 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:01.425167 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8232e672-5dd5-4fac-8a48-fbde70117603 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:01.425609 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8232e672-5dd5-4fac-8a48-fbde70117603 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:01.426296 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8232e672-5dd5-4fac-8a48-fbde70117603 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:01.426751 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8232e672-5dd5-4fac-8a48-fbde70117603 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:01.427171 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8232e672-5dd5-4fac-8a48-fbde70117603 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:01.487728 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-8232e672-5dd5-4fac-8a48-fbde70117603 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:01.496390 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-8232e672-5dd5-4fac-8a48-fbde70117603 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:01.497886 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-8232e672-5dd5-4fac-8a48-fbde70117603 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:01.498985 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-8232e672-5dd5-4fac-8a48-fbde70117603 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1277 microversion: 2.20 time: 0.084992 Aug 18 14:52:01.499539 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 55/89] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:01 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1277 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:52:02.208946 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-fc4510f8-733f-429a-8e92-2dc0b8950604 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:02.209553 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-fc4510f8-733f-429a-8e92-2dc0b8950604 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:02.211561 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=4 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:52:02.212703 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=6 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:52:02.218823 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fc4510f8-733f-429a-8e92-2dc0b8950604 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:02.219309 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fc4510f8-733f-429a-8e92-2dc0b8950604 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:02.219765 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fc4510f8-733f-429a-8e92-2dc0b8950604 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:02.220490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fc4510f8-733f-429a-8e92-2dc0b8950604 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:02.220935 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fc4510f8-733f-429a-8e92-2dc0b8950604 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:02.221363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fc4510f8-733f-429a-8e92-2dc0b8950604 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:02.294402 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-fc4510f8-733f-429a-8e92-2dc0b8950604 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:02.305801 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-fc4510f8-733f-429a-8e92-2dc0b8950604 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1293 microversion: 2.1 time: 0.100327 Aug 18 14:52:02.311967 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 35/90] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:02 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1293 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:02.380124 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-46cc5603-ad9c-4be1-85c9-3e1fac7f512b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:02.381546 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-46cc5603-ad9c-4be1-85c9-3e1fac7f512b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:02.390249 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-46cc5603-ad9c-4be1-85c9-3e1fac7f512b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:02.390830 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-46cc5603-ad9c-4be1-85c9-3e1fac7f512b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:02.391479 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-46cc5603-ad9c-4be1-85c9-3e1fac7f512b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:02.392275 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-46cc5603-ad9c-4be1-85c9-3e1fac7f512b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:02.393451 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-46cc5603-ad9c-4be1-85c9-3e1fac7f512b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:02.393451 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-46cc5603-ad9c-4be1-85c9-3e1fac7f512b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:02.405761 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-349d0be6-521d-4e5e-9f5a-75ad7b8e5887 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:02.406406 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-349d0be6-521d-4e5e-9f5a-75ad7b8e5887 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:02.420295 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-349d0be6-521d-4e5e-9f5a-75ad7b8e5887 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:02.427369 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-349d0be6-521d-4e5e-9f5a-75ad7b8e5887 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:02.428073 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-349d0be6-521d-4e5e-9f5a-75ad7b8e5887 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:02.429023 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-349d0be6-521d-4e5e-9f5a-75ad7b8e5887 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:02.429736 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-349d0be6-521d-4e5e-9f5a-75ad7b8e5887 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:02.430042 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-349d0be6-521d-4e5e-9f5a-75ad7b8e5887 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:02.506043 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-46cc5603-ad9c-4be1-85c9-3e1fac7f512b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:02.515945 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-46cc5603-ad9c-4be1-85c9-3e1fac7f512b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1232 microversion: 2.1 time: 0.139631 Aug 18 14:52:02.516829 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 56/91] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:02 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1232 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:02.522207 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-f9c4d12a-b8bd-4319-a3c3-decfd657bcc0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:02.523077 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-f9c4d12a-b8bd-4319-a3c3-decfd657bcc0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:02.530323 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f9c4d12a-b8bd-4319-a3c3-decfd657bcc0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:02.530819 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f9c4d12a-b8bd-4319-a3c3-decfd657bcc0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:02.531256 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f9c4d12a-b8bd-4319-a3c3-decfd657bcc0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:02.532066 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f9c4d12a-b8bd-4319-a3c3-decfd657bcc0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:02.532523 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f9c4d12a-b8bd-4319-a3c3-decfd657bcc0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:02.532957 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f9c4d12a-b8bd-4319-a3c3-decfd657bcc0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:02.613251 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-f9c4d12a-b8bd-4319-a3c3-decfd657bcc0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:02.621760 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-f9c4d12a-b8bd-4319-a3c3-decfd657bcc0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:02.623275 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-f9c4d12a-b8bd-4319-a3c3-decfd657bcc0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:02.624497 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-f9c4d12a-b8bd-4319-a3c3-decfd657bcc0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1333 microversion: 2.20 time: 0.106554 Aug 18 14:52:02.625061 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 57/92] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:02 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1333 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:52:02.637732 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-349d0be6-521d-4e5e-9f5a-75ad7b8e5887 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:02.646847 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-349d0be6-521d-4e5e-9f5a-75ad7b8e5887 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1314 microversion: 2.1 time: 0.245889 Aug 18 14:52:02.647509 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 36/93] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:02 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:03.336452 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-5d85e4ed-eadf-4304-9f15-3d92a14dfbea tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:03.337053 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-5d85e4ed-eadf-4304-9f15-3d92a14dfbea tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:03.343909 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5d85e4ed-eadf-4304-9f15-3d92a14dfbea tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:03.344405 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5d85e4ed-eadf-4304-9f15-3d92a14dfbea tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:03.344809 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5d85e4ed-eadf-4304-9f15-3d92a14dfbea tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:03.345496 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5d85e4ed-eadf-4304-9f15-3d92a14dfbea tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:03.346030 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5d85e4ed-eadf-4304-9f15-3d92a14dfbea tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:03.346452 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5d85e4ed-eadf-4304-9f15-3d92a14dfbea tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:03.407908 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-5d85e4ed-eadf-4304-9f15-3d92a14dfbea tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:03.415558 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-5d85e4ed-eadf-4304-9f15-3d92a14dfbea tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1301 microversion: 2.1 time: 0.083463 Aug 18 14:52:03.416137 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 58/94] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:03 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1301 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:03.537337 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0479b66a-1ba5-4aea-8208-f0b02d143c02 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:03.537953 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0479b66a-1ba5-4aea-8208-f0b02d143c02 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:03.544504 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0479b66a-1ba5-4aea-8208-f0b02d143c02 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:03.544987 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0479b66a-1ba5-4aea-8208-f0b02d143c02 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:03.545419 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0479b66a-1ba5-4aea-8208-f0b02d143c02 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:03.546180 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0479b66a-1ba5-4aea-8208-f0b02d143c02 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:03.546568 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0479b66a-1ba5-4aea-8208-f0b02d143c02 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:03.546986 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0479b66a-1ba5-4aea-8208-f0b02d143c02 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:03.606759 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-0479b66a-1ba5-4aea-8208-f0b02d143c02 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:03.614436 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0479b66a-1ba5-4aea-8208-f0b02d143c02 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1232 microversion: 2.1 time: 0.080887 Aug 18 14:52:03.615011 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 37/95] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:03 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1232 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:03.649008 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-2ff3f29c-8c4b-43ad-bd22-7c3aa326dfd7 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:03.649620 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-2ff3f29c-8c4b-43ad-bd22-7c3aa326dfd7 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:03.651530 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_cell0:SELECT=4 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:52:03.657413 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2ff3f29c-8c4b-43ad-bd22-7c3aa326dfd7 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:03.657907 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2ff3f29c-8c4b-43ad-bd22-7c3aa326dfd7 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:03.658346 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2ff3f29c-8c4b-43ad-bd22-7c3aa326dfd7 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:03.659065 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2ff3f29c-8c4b-43ad-bd22-7c3aa326dfd7 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:03.659593 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2ff3f29c-8c4b-43ad-bd22-7c3aa326dfd7 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:03.659969 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2ff3f29c-8c4b-43ad-bd22-7c3aa326dfd7 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:03.668838 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f199c0a4-f881-4d1f-82cb-199274c1661b tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:03.669529 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f199c0a4-f881-4d1f-82cb-199274c1661b tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:03.676422 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f199c0a4-f881-4d1f-82cb-199274c1661b tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:03.676838 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f199c0a4-f881-4d1f-82cb-199274c1661b tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:03.677492 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f199c0a4-f881-4d1f-82cb-199274c1661b tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:03.678210 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f199c0a4-f881-4d1f-82cb-199274c1661b tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:03.678664 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f199c0a4-f881-4d1f-82cb-199274c1661b tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:03.679085 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f199c0a4-f881-4d1f-82cb-199274c1661b tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:03.692766 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_cell0:SELECT=22 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:52:03.739514 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-2ff3f29c-8c4b-43ad-bd22-7c3aa326dfd7 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:03.748597 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-2ff3f29c-8c4b-43ad-bd22-7c3aa326dfd7 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:03.750105 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-2ff3f29c-8c4b-43ad-bd22-7c3aa326dfd7 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:03.751216 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-2ff3f29c-8c4b-43ad-bd22-7c3aa326dfd7 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1333 microversion: 2.20 time: 0.106169 Aug 18 14:52:03.751817 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 59/96] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:03 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1333 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:52:03.844064 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f199c0a4-f881-4d1f-82cb-199274c1661b tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:03.851922 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f199c0a4-f881-4d1f-82cb-199274c1661b tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1314 microversion: 2.1 time: 0.187000 Aug 18 14:52:03.852803 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 38/97] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:03 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:04.439284 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-96084afc-0401-4643-9716-78bab8b4523b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:04.439921 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-96084afc-0401-4643-9716-78bab8b4523b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:04.446110 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-96084afc-0401-4643-9716-78bab8b4523b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:04.446598 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-96084afc-0401-4643-9716-78bab8b4523b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:04.447033 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-96084afc-0401-4643-9716-78bab8b4523b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:04.447759 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-96084afc-0401-4643-9716-78bab8b4523b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:04.448210 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-96084afc-0401-4643-9716-78bab8b4523b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:04.448633 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-96084afc-0401-4643-9716-78bab8b4523b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:04.514181 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-96084afc-0401-4643-9716-78bab8b4523b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:04.522305 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-96084afc-0401-4643-9716-78bab8b4523b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1301 microversion: 2.1 time: 0.088378 Aug 18 14:52:04.522890 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 60/98] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:04 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1301 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:04.636569 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-05b8fd1a-b911-4078-b8a8-c8f468a5e5a5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:04.637087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-05b8fd1a-b911-4078-b8a8-c8f468a5e5a5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:04.643053 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-05b8fd1a-b911-4078-b8a8-c8f468a5e5a5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:04.643547 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-05b8fd1a-b911-4078-b8a8-c8f468a5e5a5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:04.644017 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-05b8fd1a-b911-4078-b8a8-c8f468a5e5a5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:04.644708 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-05b8fd1a-b911-4078-b8a8-c8f468a5e5a5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:04.645162 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-05b8fd1a-b911-4078-b8a8-c8f468a5e5a5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:04.645580 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-05b8fd1a-b911-4078-b8a8-c8f468a5e5a5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:04.707084 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-05b8fd1a-b911-4078-b8a8-c8f468a5e5a5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:04.718998 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-05b8fd1a-b911-4078-b8a8-c8f468a5e5a5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1232 microversion: 2.1 time: 0.086796 Aug 18 14:52:04.720148 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 39/99] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:04 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1232 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:04.777573 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-078d37b7-245d-49c6-a210-823727a8e1a5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:04.778182 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-078d37b7-245d-49c6-a210-823727a8e1a5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:04.784214 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-078d37b7-245d-49c6-a210-823727a8e1a5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:04.784701 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-078d37b7-245d-49c6-a210-823727a8e1a5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:04.785135 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-078d37b7-245d-49c6-a210-823727a8e1a5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:04.785831 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-078d37b7-245d-49c6-a210-823727a8e1a5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:04.786293 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-078d37b7-245d-49c6-a210-823727a8e1a5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:04.786721 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-078d37b7-245d-49c6-a210-823727a8e1a5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:04.847028 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-078d37b7-245d-49c6-a210-823727a8e1a5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:04.855767 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-078d37b7-245d-49c6-a210-823727a8e1a5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:04.857283 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-078d37b7-245d-49c6-a210-823727a8e1a5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:04.858393 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-078d37b7-245d-49c6-a210-823727a8e1a5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1333 microversion: 2.20 time: 0.085375 Aug 18 14:52:04.858954 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 61/100] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:04 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1333 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:52:04.872861 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-124e694a-0cbf-455a-8eaf-c8b3d8c98f42 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:04.873469 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-124e694a-0cbf-455a-8eaf-c8b3d8c98f42 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:04.879380 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-124e694a-0cbf-455a-8eaf-c8b3d8c98f42 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:04.879890 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-124e694a-0cbf-455a-8eaf-c8b3d8c98f42 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:04.880319 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-124e694a-0cbf-455a-8eaf-c8b3d8c98f42 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:04.881007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-124e694a-0cbf-455a-8eaf-c8b3d8c98f42 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:04.881454 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-124e694a-0cbf-455a-8eaf-c8b3d8c98f42 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:04.882155 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-124e694a-0cbf-455a-8eaf-c8b3d8c98f42 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:05.015116 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-124e694a-0cbf-455a-8eaf-c8b3d8c98f42 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:05.023248 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-124e694a-0cbf-455a-8eaf-c8b3d8c98f42 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1314 microversion: 2.1 time: 0.154345 Aug 18 14:52:05.023849 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 40/101] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:04 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:52:05.544042 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-7c86e5fc-e77c-43ec-9fcd-257568438004 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:05.544650 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-7c86e5fc-e77c-43ec-9fcd-257568438004 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:05.550709 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7c86e5fc-e77c-43ec-9fcd-257568438004 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:05.551190 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7c86e5fc-e77c-43ec-9fcd-257568438004 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:05.551616 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7c86e5fc-e77c-43ec-9fcd-257568438004 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:05.552366 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7c86e5fc-e77c-43ec-9fcd-257568438004 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:05.552826 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7c86e5fc-e77c-43ec-9fcd-257568438004 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:05.553244 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7c86e5fc-e77c-43ec-9fcd-257568438004 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:05.613994 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-7c86e5fc-e77c-43ec-9fcd-257568438004 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:05.622576 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-7c86e5fc-e77c-43ec-9fcd-257568438004 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1301 microversion: 2.1 time: 0.082856 Aug 18 14:52:05.623150 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 62/102] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:05 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1301 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:05.739724 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-29b30b0f-54e2-4f81-9086-dc2680d75c2e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:05.740341 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-29b30b0f-54e2-4f81-9086-dc2680d75c2e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:05.749691 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-29b30b0f-54e2-4f81-9086-dc2680d75c2e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:05.749691 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-29b30b0f-54e2-4f81-9086-dc2680d75c2e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:05.749691 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-29b30b0f-54e2-4f81-9086-dc2680d75c2e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:05.749691 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-29b30b0f-54e2-4f81-9086-dc2680d75c2e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:05.749980 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-29b30b0f-54e2-4f81-9086-dc2680d75c2e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:05.749980 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-29b30b0f-54e2-4f81-9086-dc2680d75c2e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:05.810613 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-29b30b0f-54e2-4f81-9086-dc2680d75c2e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:05.818817 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-29b30b0f-54e2-4f81-9086-dc2680d75c2e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1232 microversion: 2.1 time: 0.082880 Aug 18 14:52:05.819592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 41/103] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:05 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1232 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:05.884268 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-9a8583cb-7ef2-4686-b18c-d978034c2fe9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:05.885425 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-9a8583cb-7ef2-4686-b18c-d978034c2fe9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:05.892742 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9a8583cb-7ef2-4686-b18c-d978034c2fe9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:05.893159 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9a8583cb-7ef2-4686-b18c-d978034c2fe9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:05.893663 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9a8583cb-7ef2-4686-b18c-d978034c2fe9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:05.894284 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9a8583cb-7ef2-4686-b18c-d978034c2fe9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:05.894839 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9a8583cb-7ef2-4686-b18c-d978034c2fe9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:05.895316 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9a8583cb-7ef2-4686-b18c-d978034c2fe9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:05.966249 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-9a8583cb-7ef2-4686-b18c-d978034c2fe9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:05.977089 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-9a8583cb-7ef2-4686-b18c-d978034c2fe9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:05.978609 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-9a8583cb-7ef2-4686-b18c-d978034c2fe9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:05.980310 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-9a8583cb-7ef2-4686-b18c-d978034c2fe9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1333 microversion: 2.20 time: 0.102711 Aug 18 14:52:05.981605 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 63/104] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:05 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1333 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:52:06.049642 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3959db31-ca1a-4ad1-98bc-a23f3d28121c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:06.050260 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-3959db31-ca1a-4ad1-98bc-a23f3d28121c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:06.056291 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3959db31-ca1a-4ad1-98bc-a23f3d28121c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:06.056782 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3959db31-ca1a-4ad1-98bc-a23f3d28121c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:06.057209 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3959db31-ca1a-4ad1-98bc-a23f3d28121c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:06.057904 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3959db31-ca1a-4ad1-98bc-a23f3d28121c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:06.058354 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3959db31-ca1a-4ad1-98bc-a23f3d28121c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:06.058776 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3959db31-ca1a-4ad1-98bc-a23f3d28121c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:06.190308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-3959db31-ca1a-4ad1-98bc-a23f3d28121c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:06.198937 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-3959db31-ca1a-4ad1-98bc-a23f3d28121c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1314 microversion: 2.1 time: 0.155024 Aug 18 14:52:06.199568 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 42/105] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:06 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:06.644285 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-28e6eca1-3c30-40b3-9172-f0235b7ac683 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:06.645074 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-28e6eca1-3c30-40b3-9172-f0235b7ac683 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:06.651129 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-28e6eca1-3c30-40b3-9172-f0235b7ac683 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:06.652019 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-28e6eca1-3c30-40b3-9172-f0235b7ac683 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:06.652603 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-28e6eca1-3c30-40b3-9172-f0235b7ac683 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:06.653657 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-28e6eca1-3c30-40b3-9172-f0235b7ac683 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:06.654493 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-28e6eca1-3c30-40b3-9172-f0235b7ac683 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:06.654923 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-28e6eca1-3c30-40b3-9172-f0235b7ac683 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:06.720868 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-28e6eca1-3c30-40b3-9172-f0235b7ac683 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:06.728626 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-28e6eca1-3c30-40b3-9172-f0235b7ac683 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1301 microversion: 2.1 time: 0.089129 Aug 18 14:52:06.729184 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 64/106] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:06 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1301 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:06.839968 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-662276aa-8129-4788-8491-8c645ab8c15f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:06.840604 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-662276aa-8129-4788-8491-8c645ab8c15f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:06.847079 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-662276aa-8129-4788-8491-8c645ab8c15f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:06.847573 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-662276aa-8129-4788-8491-8c645ab8c15f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:06.848032 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-662276aa-8129-4788-8491-8c645ab8c15f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:06.848740 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-662276aa-8129-4788-8491-8c645ab8c15f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:06.849195 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-662276aa-8129-4788-8491-8c645ab8c15f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:06.849617 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-662276aa-8129-4788-8491-8c645ab8c15f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:06.916099 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-662276aa-8129-4788-8491-8c645ab8c15f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:06.924525 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-662276aa-8129-4788-8491-8c645ab8c15f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1232 microversion: 2.1 time: 0.088413 Aug 18 14:52:06.933550 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 43/107] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:06 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1232 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:07.002778 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-9de3fd2c-67b8-4b04-aaf7-587403871b81 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:07.003381 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-9de3fd2c-67b8-4b04-aaf7-587403871b81 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:07.010078 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9de3fd2c-67b8-4b04-aaf7-587403871b81 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:07.010439 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9de3fd2c-67b8-4b04-aaf7-587403871b81 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:07.010950 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9de3fd2c-67b8-4b04-aaf7-587403871b81 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:07.011649 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9de3fd2c-67b8-4b04-aaf7-587403871b81 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:07.012125 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9de3fd2c-67b8-4b04-aaf7-587403871b81 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:07.012543 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9de3fd2c-67b8-4b04-aaf7-587403871b81 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:07.015457 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_cell1:SELECT=100 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:52:07.078241 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-9de3fd2c-67b8-4b04-aaf7-587403871b81 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:07.086522 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-9de3fd2c-67b8-4b04-aaf7-587403871b81 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:07.088061 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-9de3fd2c-67b8-4b04-aaf7-587403871b81 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:07.089202 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-9de3fd2c-67b8-4b04-aaf7-587403871b81 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1333 microversion: 2.20 time: 0.090244 Aug 18 14:52:07.089789 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 65/108] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:06 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1333 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:52:07.220393 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-edb2a4da-342f-42ed-a4ee-079e717e682c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:07.221038 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-edb2a4da-342f-42ed-a4ee-079e717e682c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:07.226981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-edb2a4da-342f-42ed-a4ee-079e717e682c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:07.227465 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-edb2a4da-342f-42ed-a4ee-079e717e682c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:07.227932 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-edb2a4da-342f-42ed-a4ee-079e717e682c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:07.228631 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-edb2a4da-342f-42ed-a4ee-079e717e682c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:07.229084 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-edb2a4da-342f-42ed-a4ee-079e717e682c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:07.229520 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-edb2a4da-342f-42ed-a4ee-079e717e682c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:07.364274 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-edb2a4da-342f-42ed-a4ee-079e717e682c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:07.372447 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-edb2a4da-342f-42ed-a4ee-079e717e682c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1314 microversion: 2.1 time: 0.155888 Aug 18 14:52:07.373005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 44/109] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:07 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:07.749564 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-e79d4062-bdbc-4688-9352-dea77bb995d9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:07.750170 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-e79d4062-bdbc-4688-9352-dea77bb995d9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:07.756046 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e79d4062-bdbc-4688-9352-dea77bb995d9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:07.756532 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e79d4062-bdbc-4688-9352-dea77bb995d9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:07.757223 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e79d4062-bdbc-4688-9352-dea77bb995d9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:07.757917 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e79d4062-bdbc-4688-9352-dea77bb995d9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:07.758360 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e79d4062-bdbc-4688-9352-dea77bb995d9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:07.758773 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e79d4062-bdbc-4688-9352-dea77bb995d9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:07.827301 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-e79d4062-bdbc-4688-9352-dea77bb995d9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:07.835247 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-e79d4062-bdbc-4688-9352-dea77bb995d9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1301 microversion: 2.1 time: 0.089755 Aug 18 14:52:07.835844 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 66/110] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:07 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1301 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:07.946553 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-59beae8e-e670-4dfb-b323-520311cd77ae tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:07.947191 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-59beae8e-e670-4dfb-b323-520311cd77ae tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:07.953948 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-59beae8e-e670-4dfb-b323-520311cd77ae tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:07.954434 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-59beae8e-e670-4dfb-b323-520311cd77ae tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:07.954869 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-59beae8e-e670-4dfb-b323-520311cd77ae tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:07.955552 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-59beae8e-e670-4dfb-b323-520311cd77ae tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:07.956029 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-59beae8e-e670-4dfb-b323-520311cd77ae tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:07.956449 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-59beae8e-e670-4dfb-b323-520311cd77ae tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:08.018945 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-59beae8e-e670-4dfb-b323-520311cd77ae tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:08.026686 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-59beae8e-e670-4dfb-b323-520311cd77ae tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1232 microversion: 2.1 time: 0.083992 Aug 18 14:52:08.027249 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 45/111] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:07 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1232 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:08.112274 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-01fe8bd6-d119-46a9-b4d5-5317e12e42b5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:08.112891 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-01fe8bd6-d119-46a9-b4d5-5317e12e42b5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:08.119077 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-01fe8bd6-d119-46a9-b4d5-5317e12e42b5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:08.119559 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-01fe8bd6-d119-46a9-b4d5-5317e12e42b5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:08.120535 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-01fe8bd6-d119-46a9-b4d5-5317e12e42b5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:08.121239 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-01fe8bd6-d119-46a9-b4d5-5317e12e42b5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:08.121694 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-01fe8bd6-d119-46a9-b4d5-5317e12e42b5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:08.122113 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-01fe8bd6-d119-46a9-b4d5-5317e12e42b5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:08.185101 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-01fe8bd6-d119-46a9-b4d5-5317e12e42b5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:08.193316 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-01fe8bd6-d119-46a9-b4d5-5317e12e42b5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:08.194801 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-01fe8bd6-d119-46a9-b4d5-5317e12e42b5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:08.195934 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-01fe8bd6-d119-46a9-b4d5-5317e12e42b5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1333 microversion: 2.20 time: 0.087842 Aug 18 14:52:08.196496 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 67/112] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:08 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1333 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:52:08.392649 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e448536f-ea26-4648-a8be-d38534018d51 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:08.393564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e448536f-ea26-4648-a8be-d38534018d51 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:08.400142 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e448536f-ea26-4648-a8be-d38534018d51 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:08.400715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e448536f-ea26-4648-a8be-d38534018d51 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:08.401225 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e448536f-ea26-4648-a8be-d38534018d51 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:08.402000 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e448536f-ea26-4648-a8be-d38534018d51 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:08.402531 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e448536f-ea26-4648-a8be-d38534018d51 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:08.403026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e448536f-ea26-4648-a8be-d38534018d51 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:08.532432 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e448536f-ea26-4648-a8be-d38534018d51 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:08.534592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=100 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:52:08.541293 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e448536f-ea26-4648-a8be-d38534018d51 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1314 microversion: 2.1 time: 0.152499 Aug 18 14:52:08.541850 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 46/113] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:08 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:08.857447 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-4497c4e4-0623-4d64-ad8b-c95eb02279c0 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:08.858055 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-4497c4e4-0623-4d64-ad8b-c95eb02279c0 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:08.864176 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4497c4e4-0623-4d64-ad8b-c95eb02279c0 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:08.864651 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4497c4e4-0623-4d64-ad8b-c95eb02279c0 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:08.865082 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4497c4e4-0623-4d64-ad8b-c95eb02279c0 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:08.865764 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4497c4e4-0623-4d64-ad8b-c95eb02279c0 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:08.866213 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4497c4e4-0623-4d64-ad8b-c95eb02279c0 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:08.866627 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4497c4e4-0623-4d64-ad8b-c95eb02279c0 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:08.930612 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-4497c4e4-0623-4d64-ad8b-c95eb02279c0 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:08.938862 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-4497c4e4-0623-4d64-ad8b-c95eb02279c0 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1301 microversion: 2.1 time: 0.085864 Aug 18 14:52:08.939428 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 68/114] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:08 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1301 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:09.047791 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0004439f-12f2-470b-bf81-7bf798debf78 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:09.048306 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0004439f-12f2-470b-bf81-7bf798debf78 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:09.054489 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0004439f-12f2-470b-bf81-7bf798debf78 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:09.054964 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0004439f-12f2-470b-bf81-7bf798debf78 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:09.055394 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0004439f-12f2-470b-bf81-7bf798debf78 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:09.056108 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0004439f-12f2-470b-bf81-7bf798debf78 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:09.056682 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0004439f-12f2-470b-bf81-7bf798debf78 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:09.057198 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0004439f-12f2-470b-bf81-7bf798debf78 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:09.124515 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-0004439f-12f2-470b-bf81-7bf798debf78 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:09.133999 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0004439f-12f2-470b-bf81-7bf798debf78 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1232 microversion: 2.1 time: 0.090361 Aug 18 14:52:09.134579 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 47/115] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:09 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1232 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:09.219203 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-372314b1-a32c-4a17-bfd8-0f696b6f96ef tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:09.219842 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-372314b1-a32c-4a17-bfd8-0f696b6f96ef tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:09.225890 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-372314b1-a32c-4a17-bfd8-0f696b6f96ef tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:09.226370 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-372314b1-a32c-4a17-bfd8-0f696b6f96ef tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:09.226974 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-372314b1-a32c-4a17-bfd8-0f696b6f96ef tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:09.227669 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-372314b1-a32c-4a17-bfd8-0f696b6f96ef tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:09.228147 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-372314b1-a32c-4a17-bfd8-0f696b6f96ef tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:09.228567 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-372314b1-a32c-4a17-bfd8-0f696b6f96ef tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:09.390858 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-372314b1-a32c-4a17-bfd8-0f696b6f96ef tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:09.404879 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-372314b1-a32c-4a17-bfd8-0f696b6f96ef tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:09.407803 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-372314b1-a32c-4a17-bfd8-0f696b6f96ef tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:09.408966 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-372314b1-a32c-4a17-bfd8-0f696b6f96ef tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1333 microversion: 2.20 time: 0.193824 Aug 18 14:52:09.410820 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 69/116] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:09 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1333 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:52:09.564130 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-99210bb1-bc14-4ea5-8b9c-fff58e907882 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:09.564788 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-99210bb1-bc14-4ea5-8b9c-fff58e907882 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:09.571447 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-99210bb1-bc14-4ea5-8b9c-fff58e907882 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:09.572048 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-99210bb1-bc14-4ea5-8b9c-fff58e907882 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:09.572510 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-99210bb1-bc14-4ea5-8b9c-fff58e907882 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:09.574116 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-99210bb1-bc14-4ea5-8b9c-fff58e907882 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:09.574898 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-99210bb1-bc14-4ea5-8b9c-fff58e907882 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:09.575418 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-99210bb1-bc14-4ea5-8b9c-fff58e907882 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:09.782046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-99210bb1-bc14-4ea5-8b9c-fff58e907882 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:09.795235 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-99210bb1-bc14-4ea5-8b9c-fff58e907882 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1314 microversion: 2.1 time: 0.235605 Aug 18 14:52:09.796548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 48/117] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:09 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:09.961427 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-fc5ac39b-4d65-4493-ba48-acc69a7c4b15 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:09.962365 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-fc5ac39b-4d65-4493-ba48-acc69a7c4b15 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:09.969231 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fc5ac39b-4d65-4493-ba48-acc69a7c4b15 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:09.970244 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fc5ac39b-4d65-4493-ba48-acc69a7c4b15 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:09.970885 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fc5ac39b-4d65-4493-ba48-acc69a7c4b15 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:09.971727 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fc5ac39b-4d65-4493-ba48-acc69a7c4b15 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:09.972212 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fc5ac39b-4d65-4493-ba48-acc69a7c4b15 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:09.972630 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fc5ac39b-4d65-4493-ba48-acc69a7c4b15 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:10.047159 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-fc5ac39b-4d65-4493-ba48-acc69a7c4b15 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:10.056181 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-fc5ac39b-4d65-4493-ba48-acc69a7c4b15 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1299 microversion: 2.1 time: 0.099594 Aug 18 14:52:10.057080 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 70/118] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:09 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1299 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:10.158174 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ea67845a-e19e-4ca2-ad84-d54a24209366 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:10.159432 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ea67845a-e19e-4ca2-ad84-d54a24209366 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:10.166475 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ea67845a-e19e-4ca2-ad84-d54a24209366 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:10.167485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ea67845a-e19e-4ca2-ad84-d54a24209366 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:10.168160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ea67845a-e19e-4ca2-ad84-d54a24209366 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:10.168943 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ea67845a-e19e-4ca2-ad84-d54a24209366 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:10.170583 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ea67845a-e19e-4ca2-ad84-d54a24209366 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:10.171070 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ea67845a-e19e-4ca2-ad84-d54a24209366 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:10.441075 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-7352442a-4722-4645-8a6e-f3ce9c0d571a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:10.442730 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-7352442a-4722-4645-8a6e-f3ce9c0d571a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:10.450204 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7352442a-4722-4645-8a6e-f3ce9c0d571a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:10.450987 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7352442a-4722-4645-8a6e-f3ce9c0d571a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:10.452304 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7352442a-4722-4645-8a6e-f3ce9c0d571a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:10.453249 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7352442a-4722-4645-8a6e-f3ce9c0d571a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:10.453940 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7352442a-4722-4645-8a6e-f3ce9c0d571a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:10.454590 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7352442a-4722-4645-8a6e-f3ce9c0d571a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:10.534584 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ea67845a-e19e-4ca2-ad84-d54a24209366 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:10.544996 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-ea67845a-e19e-4ca2-ad84-d54a24209366 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1288 microversion: 2.1 time: 0.390805 Aug 18 14:52:10.546202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 49/119] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:10 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1288 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:10.572768 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-7352442a-4722-4645-8a6e-f3ce9c0d571a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:10.582407 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-7352442a-4722-4645-8a6e-f3ce9c0d571a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:10.584153 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-7352442a-4722-4645-8a6e-f3ce9c0d571a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:10.585809 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-7352442a-4722-4645-8a6e-f3ce9c0d571a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1339 microversion: 2.20 time: 0.152228 Aug 18 14:52:10.600570 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 71/120] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:10 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1339 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:52:10.823415 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0d104a98-1cdd-4329-a93a-4b098ca26488 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:10.824861 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0d104a98-1cdd-4329-a93a-4b098ca26488 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:10.842269 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0d104a98-1cdd-4329-a93a-4b098ca26488 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:10.843295 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0d104a98-1cdd-4329-a93a-4b098ca26488 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:10.844504 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0d104a98-1cdd-4329-a93a-4b098ca26488 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:10.845988 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0d104a98-1cdd-4329-a93a-4b098ca26488 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:10.848106 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0d104a98-1cdd-4329-a93a-4b098ca26488 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:10.848914 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0d104a98-1cdd-4329-a93a-4b098ca26488 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:11.081431 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-2a50604a-9b8a-4d69-903f-9e6b89ab7772 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:11.082134 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-2a50604a-9b8a-4d69-903f-9e6b89ab7772 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:11.093458 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2a50604a-9b8a-4d69-903f-9e6b89ab7772 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:11.108515 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2a50604a-9b8a-4d69-903f-9e6b89ab7772 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:11.109092 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2a50604a-9b8a-4d69-903f-9e6b89ab7772 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:11.112777 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2a50604a-9b8a-4d69-903f-9e6b89ab7772 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:11.114150 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2a50604a-9b8a-4d69-903f-9e6b89ab7772 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:11.115466 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2a50604a-9b8a-4d69-903f-9e6b89ab7772 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:11.279324 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-2a50604a-9b8a-4d69-903f-9e6b89ab7772 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:11.301708 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-2a50604a-9b8a-4d69-903f-9e6b89ab7772 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1299 microversion: 2.1 time: 0.220291 Aug 18 14:52:11.316987 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 72/121] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:11 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1299 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:11.322472 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-0d104a98-1cdd-4329-a93a-4b098ca26488 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:11.344629 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0d104a98-1cdd-4329-a93a-4b098ca26488 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1314 microversion: 2.1 time: 0.530180 Aug 18 14:52:11.346137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 50/122] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:10 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:11.566176 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c6014d18-cc0f-4f9b-96be-1604a063d293 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:11.566801 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c6014d18-cc0f-4f9b-96be-1604a063d293 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:11.575532 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c6014d18-cc0f-4f9b-96be-1604a063d293 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:11.578542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c6014d18-cc0f-4f9b-96be-1604a063d293 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:11.579036 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c6014d18-cc0f-4f9b-96be-1604a063d293 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:11.581854 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c6014d18-cc0f-4f9b-96be-1604a063d293 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:11.582351 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c6014d18-cc0f-4f9b-96be-1604a063d293 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:11.582823 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c6014d18-cc0f-4f9b-96be-1604a063d293 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:11.625167 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [req-cd3e1e69-840d-4dc5-bd2d-9ef076fd527b req-7bd275d9-83ec-47cb-8d91-b09c4c1ef695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aa2e996-a18b-49a2-8456-afb00be537d4", "name": "network-vif-plugged", "status": "completed", "tag": "bfa6223e-f2cb-4716-b5bd-450125b52439"}]} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:52:11.642818 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-cd3e1e69-840d-4dc5-bd2d-9ef076fd527b req-7bd275d9-83ec-47cb-8d91-b09c4c1ef695 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:11.643799 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-cd3e1e69-840d-4dc5-bd2d-9ef076fd527b req-7bd275d9-83ec-47cb-8d91-b09c4c1ef695 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:11.644688 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-cd3e1e69-840d-4dc5-bd2d-9ef076fd527b req-7bd275d9-83ec-47cb-8d91-b09c4c1ef695 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:11.670370 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.compute.server_external_events [req-cd3e1e69-840d-4dc5-bd2d-9ef076fd527b req-7bd275d9-83ec-47cb-8d91-b09c4c1ef695 service nova] Creating event network-vif-plugged:bfa6223e-f2cb-4716-b5bd-450125b52439 for instance 5aa2e996-a18b-49a2-8456-afb00be537d4 on hv-cinder-85220 Aug 18 14:52:11.671290 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-cd3e1e69-840d-4dc5-bd2d-9ef076fd527b req-7bd275d9-83ec-47cb-8d91-b09c4c1ef695 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132267) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 14:52:11.671949 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-cd3e1e69-840d-4dc5-bd2d-9ef076fd527b req-7bd275d9-83ec-47cb-8d91-b09c4c1ef695 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132267) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 14:52:11.673674 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-107ee897-23e9-41d8-a343-670c0ceef914 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:11.674745 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-107ee897-23e9-41d8-a343-670c0ceef914 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:11.675332 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-107ee897-23e9-41d8-a343-670c0ceef914 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:11.676246 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-107ee897-23e9-41d8-a343-670c0ceef914 None None] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:11.677122 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-107ee897-23e9-41d8-a343-670c0ceef914 None None] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:11.677942 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-107ee897-23e9-41d8-a343-670c0ceef914 None None] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:11.700399 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.compute.rpcapi [None req-107ee897-23e9-41d8-a343-670c0ceef914 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 18 14:52:11.702255 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-107ee897-23e9-41d8-a343-670c0ceef914 None None] Releasing lock "compute-rpcapi-router" {{(pid=132267) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 14:52:11.733627 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-107ee897-23e9-41d8-a343-670c0ceef914 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.413222 Aug 18 14:52:11.734582 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 73/123] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:52:11.744825 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-83e7171d-c7dc-4bc0-922f-7e782047eb77 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:11.745596 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-83e7171d-c7dc-4bc0-922f-7e782047eb77 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:11.758796 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-83e7171d-c7dc-4bc0-922f-7e782047eb77 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:11.759763 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-83e7171d-c7dc-4bc0-922f-7e782047eb77 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:11.760403 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-83e7171d-c7dc-4bc0-922f-7e782047eb77 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:11.761351 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-83e7171d-c7dc-4bc0-922f-7e782047eb77 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:11.762053 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-83e7171d-c7dc-4bc0-922f-7e782047eb77 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:11.762690 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-83e7171d-c7dc-4bc0-922f-7e782047eb77 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:11.822257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c6014d18-cc0f-4f9b-96be-1604a063d293 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:11.834901 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c6014d18-cc0f-4f9b-96be-1604a063d293 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1294 microversion: 2.1 time: 0.272813 Aug 18 14:52:11.836173 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 51/124] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:11 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1294 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:52:11.879215 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-83e7171d-c7dc-4bc0-922f-7e782047eb77 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:11.913673 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-83e7171d-c7dc-4bc0-922f-7e782047eb77 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:11.915668 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-83e7171d-c7dc-4bc0-922f-7e782047eb77 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:11.925705 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-83e7171d-c7dc-4bc0-922f-7e782047eb77 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1339 microversion: 2.20 time: 0.189657 Aug 18 14:52:11.932852 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 74/125] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:11 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1339 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:52:12.327184 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d84696cf-5710-4c6b-817d-f7001602c1b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:12.328669 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d84696cf-5710-4c6b-817d-f7001602c1b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:12.336890 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d84696cf-5710-4c6b-817d-f7001602c1b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:12.337933 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d84696cf-5710-4c6b-817d-f7001602c1b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:12.338671 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d84696cf-5710-4c6b-817d-f7001602c1b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:12.339988 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d84696cf-5710-4c6b-817d-f7001602c1b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:12.341580 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d84696cf-5710-4c6b-817d-f7001602c1b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:12.342107 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d84696cf-5710-4c6b-817d-f7001602c1b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:12.368415 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-47af9535-7856-4213-bde3-714b1bc8b31c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:12.369236 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-47af9535-7856-4213-bde3-714b1bc8b31c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:12.380720 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-47af9535-7856-4213-bde3-714b1bc8b31c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:12.381212 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-47af9535-7856-4213-bde3-714b1bc8b31c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:12.384200 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-47af9535-7856-4213-bde3-714b1bc8b31c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:12.385460 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-47af9535-7856-4213-bde3-714b1bc8b31c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:12.387430 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-47af9535-7856-4213-bde3-714b1bc8b31c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:12.393065 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-47af9535-7856-4213-bde3-714b1bc8b31c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:12.800479 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d84696cf-5710-4c6b-817d-f7001602c1b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:12.808571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d84696cf-5710-4c6b-817d-f7001602c1b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1367 microversion: 2.1 time: 0.486730 Aug 18 14:52:12.809149 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 52/126] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:12 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1367 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:12.863801 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a868faec-c5b3-4b6b-a58d-f14e416e020d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:12.864425 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a868faec-c5b3-4b6b-a58d-f14e416e020d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:12.886909 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a868faec-c5b3-4b6b-a58d-f14e416e020d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:12.887425 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a868faec-c5b3-4b6b-a58d-f14e416e020d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:12.887896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a868faec-c5b3-4b6b-a58d-f14e416e020d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:12.888966 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-47af9535-7856-4213-bde3-714b1bc8b31c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:12.892055 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a868faec-c5b3-4b6b-a58d-f14e416e020d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:12.892546 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a868faec-c5b3-4b6b-a58d-f14e416e020d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:12.892983 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a868faec-c5b3-4b6b-a58d-f14e416e020d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:12.907029 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-47af9535-7856-4213-bde3-714b1bc8b31c tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1314 microversion: 2.1 time: 0.543907 Aug 18 14:52:12.907621 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 75/127] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:12 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:12.958717 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-437b8596-95a8-431b-b6c4-79db08291627 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:12.959442 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-437b8596-95a8-431b-b6c4-79db08291627 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:12.968901 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-437b8596-95a8-431b-b6c4-79db08291627 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:12.969667 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-437b8596-95a8-431b-b6c4-79db08291627 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:12.970745 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-437b8596-95a8-431b-b6c4-79db08291627 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:12.971526 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-437b8596-95a8-431b-b6c4-79db08291627 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:12.972237 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-437b8596-95a8-431b-b6c4-79db08291627 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:12.972669 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-437b8596-95a8-431b-b6c4-79db08291627 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:13.192242 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a868faec-c5b3-4b6b-a58d-f14e416e020d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:13.208625 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a868faec-c5b3-4b6b-a58d-f14e416e020d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1362 microversion: 2.1 time: 0.349866 Aug 18 14:52:13.220174 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-437b8596-95a8-431b-b6c4-79db08291627 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:13.228200 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 53/128] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:12 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1362 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:13.236222 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-437b8596-95a8-431b-b6c4-79db08291627 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:13.238656 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-437b8596-95a8-431b-b6c4-79db08291627 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:13.240375 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-437b8596-95a8-431b-b6c4-79db08291627 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1407 microversion: 2.20 time: 0.288059 Aug 18 14:52:13.241097 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 76/129] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:12 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1407 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:52:13.828755 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-921e8172-45b6-44cf-b30e-81b015cab34e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:13.830193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-921e8172-45b6-44cf-b30e-81b015cab34e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:13.841789 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-921e8172-45b6-44cf-b30e-81b015cab34e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:13.843448 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-921e8172-45b6-44cf-b30e-81b015cab34e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:13.844124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-921e8172-45b6-44cf-b30e-81b015cab34e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:13.845784 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-921e8172-45b6-44cf-b30e-81b015cab34e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:13.847610 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-921e8172-45b6-44cf-b30e-81b015cab34e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:13.848850 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-921e8172-45b6-44cf-b30e-81b015cab34e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:13.929751 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-3286e9d5-9337-4ce3-9878-2563d29174e9 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:13.934055 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-3286e9d5-9337-4ce3-9878-2563d29174e9 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:13.941586 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-3286e9d5-9337-4ce3-9878-2563d29174e9 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:13.942390 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-3286e9d5-9337-4ce3-9878-2563d29174e9 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:13.943073 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-3286e9d5-9337-4ce3-9878-2563d29174e9 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:13.944038 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-3286e9d5-9337-4ce3-9878-2563d29174e9 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:13.944718 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-3286e9d5-9337-4ce3-9878-2563d29174e9 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:13.945332 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-3286e9d5-9337-4ce3-9878-2563d29174e9 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:14.218659 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-921e8172-45b6-44cf-b30e-81b015cab34e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:14.228532 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-921e8172-45b6-44cf-b30e-81b015cab34e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1367 microversion: 2.1 time: 0.403982 Aug 18 14:52:14.229954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 54/130] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:13 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1367 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:14.244735 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-400d11ed-1cf0-4c71-ae55-caf1625b45cb tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:14.245765 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-400d11ed-1cf0-4c71-ae55-caf1625b45cb tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:14.253752 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-400d11ed-1cf0-4c71-ae55-caf1625b45cb tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:14.255059 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-400d11ed-1cf0-4c71-ae55-caf1625b45cb tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:14.255831 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-400d11ed-1cf0-4c71-ae55-caf1625b45cb tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:14.257433 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-400d11ed-1cf0-4c71-ae55-caf1625b45cb tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:14.258024 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-400d11ed-1cf0-4c71-ae55-caf1625b45cb tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:14.259010 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-400d11ed-1cf0-4c71-ae55-caf1625b45cb tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:14.283612 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-3286e9d5-9337-4ce3-9878-2563d29174e9 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:14.295960 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-3286e9d5-9337-4ce3-9878-2563d29174e9 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1314 microversion: 2.1 time: 0.369910 Aug 18 14:52:14.296753 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 77/131] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:13 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:14.301936 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-7c6dfcd0-27a7-400a-985b-c845d0e25802 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:14.302790 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-7c6dfcd0-27a7-400a-985b-c845d0e25802 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:14.309933 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7c6dfcd0-27a7-400a-985b-c845d0e25802 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:14.310667 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7c6dfcd0-27a7-400a-985b-c845d0e25802 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:14.311085 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7c6dfcd0-27a7-400a-985b-c845d0e25802 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:14.311968 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7c6dfcd0-27a7-400a-985b-c845d0e25802 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:14.312417 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7c6dfcd0-27a7-400a-985b-c845d0e25802 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:14.312832 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7c6dfcd0-27a7-400a-985b-c845d0e25802 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:14.758940 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-400d11ed-1cf0-4c71-ae55-caf1625b45cb tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:14.776398 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-400d11ed-1cf0-4c71-ae55-caf1625b45cb tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1362 microversion: 2.1 time: 0.535785 Aug 18 14:52:14.783747 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 55/132] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:14 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1362 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:52:14.939726 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-7c6dfcd0-27a7-400a-985b-c845d0e25802 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:14.953389 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-7c6dfcd0-27a7-400a-985b-c845d0e25802 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:14.955045 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-7c6dfcd0-27a7-400a-985b-c845d0e25802 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:14.965894 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-7c6dfcd0-27a7-400a-985b-c845d0e25802 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1407 microversion: 2.20 time: 0.667630 Aug 18 14:52:14.967491 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 78/133] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:14 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1407 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:52:15.252263 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3c1501da-8547-4f17-b001-4fdeb855107d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:15.252915 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-3c1501da-8547-4f17-b001-4fdeb855107d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:15.265595 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3c1501da-8547-4f17-b001-4fdeb855107d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:15.266100 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3c1501da-8547-4f17-b001-4fdeb855107d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:15.266537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3c1501da-8547-4f17-b001-4fdeb855107d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:15.267254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3c1501da-8547-4f17-b001-4fdeb855107d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:15.267725 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3c1501da-8547-4f17-b001-4fdeb855107d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:15.268160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3c1501da-8547-4f17-b001-4fdeb855107d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:15.318338 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-53721c9b-c8b6-48cc-9698-081f8ba710f9 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:15.318966 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-53721c9b-c8b6-48cc-9698-081f8ba710f9 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:15.329579 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-53721c9b-c8b6-48cc-9698-081f8ba710f9 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:15.330151 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-53721c9b-c8b6-48cc-9698-081f8ba710f9 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:15.335508 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-53721c9b-c8b6-48cc-9698-081f8ba710f9 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:15.336638 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-53721c9b-c8b6-48cc-9698-081f8ba710f9 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:15.338127 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-53721c9b-c8b6-48cc-9698-081f8ba710f9 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:15.338569 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-53721c9b-c8b6-48cc-9698-081f8ba710f9 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:15.935417 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-3c1501da-8547-4f17-b001-4fdeb855107d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:15.946724 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-3c1501da-8547-4f17-b001-4fdeb855107d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1367 microversion: 2.1 time: 0.697157 Aug 18 14:52:15.949986 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 56/134] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:15 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1367 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:15.958197 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-009abbab-e6d6-4c21-aec5-3c4dd23a3c46 req-5ee17208-71e2-4827-a1dd-526865eb8a1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9d85d35-e080-4901-a147-87b0aaf6c5e5", "tag": "8ef940b0-b304-4979-ad53-fd987e997f5f"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:52:16.004110 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-009abbab-e6d6-4c21-aec5-3c4dd23a3c46 req-5ee17208-71e2-4827-a1dd-526865eb8a1b service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:16.005017 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-009abbab-e6d6-4c21-aec5-3c4dd23a3c46 req-5ee17208-71e2-4827-a1dd-526865eb8a1b service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:16.005572 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-009abbab-e6d6-4c21-aec5-3c4dd23a3c46 req-5ee17208-71e2-4827-a1dd-526865eb8a1b service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:16.036520 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-009abbab-e6d6-4c21-aec5-3c4dd23a3c46 req-5ee17208-71e2-4827-a1dd-526865eb8a1b service nova] Creating event network-changed:8ef940b0-b304-4979-ad53-fd987e997f5f for instance c9d85d35-e080-4901-a147-87b0aaf6c5e5 on hv-cinder-85220 Aug 18 14:52:16.044230 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-009abbab-e6d6-4c21-aec5-3c4dd23a3c46 req-5ee17208-71e2-4827-a1dd-526865eb8a1b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092896 Aug 18 14:52:16.045219 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 57/135] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:52:16.059400 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a3785bda-4947-47fe-a729-546f23a5a6b7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:16.062691 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a3785bda-4947-47fe-a729-546f23a5a6b7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:16.070474 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-53721c9b-c8b6-48cc-9698-081f8ba710f9 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:16.078015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a3785bda-4947-47fe-a729-546f23a5a6b7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:16.078744 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a3785bda-4947-47fe-a729-546f23a5a6b7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:16.079620 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a3785bda-4947-47fe-a729-546f23a5a6b7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:16.080229 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-53721c9b-c8b6-48cc-9698-081f8ba710f9 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1314 microversion: 2.1 time: 0.766211 Aug 18 14:52:16.082294 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a3785bda-4947-47fe-a729-546f23a5a6b7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:16.083008 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 79/136] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:15 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1314 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:16.096441 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a3785bda-4947-47fe-a729-546f23a5a6b7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:16.096731 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a3785bda-4947-47fe-a729-546f23a5a6b7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:16.110825 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-e465ab43-c852-4d0c-87a1-10c900f6850a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:16.111442 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-e465ab43-c852-4d0c-87a1-10c900f6850a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:16.133683 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e465ab43-c852-4d0c-87a1-10c900f6850a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:16.134464 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e465ab43-c852-4d0c-87a1-10c900f6850a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:16.135990 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e465ab43-c852-4d0c-87a1-10c900f6850a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:16.140746 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e465ab43-c852-4d0c-87a1-10c900f6850a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:16.141368 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e465ab43-c852-4d0c-87a1-10c900f6850a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:16.141946 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e465ab43-c852-4d0c-87a1-10c900f6850a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:16.694017 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a3785bda-4947-47fe-a729-546f23a5a6b7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:16.704421 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a3785bda-4947-47fe-a729-546f23a5a6b7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1362 microversion: 2.1 time: 0.657083 Aug 18 14:52:16.719384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 58/137] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:16 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1362 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:16.721458 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-e465ab43-c852-4d0c-87a1-10c900f6850a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:16.731205 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-e465ab43-c852-4d0c-87a1-10c900f6850a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:16.733467 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-e465ab43-c852-4d0c-87a1-10c900f6850a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:16.734685 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-e465ab43-c852-4d0c-87a1-10c900f6850a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1407 microversion: 2.20 time: 0.649954 Aug 18 14:52:16.735349 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 80/138] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:16 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1407 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:52:16.971758 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-4925e665-14e7-48fb-b290-34de073cdfee tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:16.972312 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-4925e665-14e7-48fb-b290-34de073cdfee tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:16.983101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4925e665-14e7-48fb-b290-34de073cdfee tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:16.984178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4925e665-14e7-48fb-b290-34de073cdfee tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:16.984859 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4925e665-14e7-48fb-b290-34de073cdfee tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:16.985647 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4925e665-14e7-48fb-b290-34de073cdfee tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:16.986314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4925e665-14e7-48fb-b290-34de073cdfee tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:16.986791 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4925e665-14e7-48fb-b290-34de073cdfee tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:17.102864 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-d28a1091-ba34-4424-b94f-41240c347d98 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:17.103477 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-d28a1091-ba34-4424-b94f-41240c347d98 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:17.116226 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d28a1091-ba34-4424-b94f-41240c347d98 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:17.117245 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d28a1091-ba34-4424-b94f-41240c347d98 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:17.119670 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d28a1091-ba34-4424-b94f-41240c347d98 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:17.121114 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d28a1091-ba34-4424-b94f-41240c347d98 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:17.121646 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d28a1091-ba34-4424-b94f-41240c347d98 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:17.122050 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d28a1091-ba34-4424-b94f-41240c347d98 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:17.402182 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-4925e665-14e7-48fb-b290-34de073cdfee tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:17.413294 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-d28a1091-ba34-4424-b94f-41240c347d98 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:17.421253 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-d28a1091-ba34-4424-b94f-41240c347d98 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1314 microversion: 2.1 time: 0.322443 Aug 18 14:52:17.421843 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 81/139] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:17 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:17.426892 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-4925e665-14e7-48fb-b290-34de073cdfee tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1367 microversion: 2.1 time: 0.462325 Aug 18 14:52:17.436497 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 59/140] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:16 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1367 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:17.526755 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-067629e7-2f23-41c8-912c-15249410c46f req-c94789dd-a2a1-44c3-947d-48be306130ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d2b6fc4-0338-4141-9ac3-7b579718fae9", "tag": "54c7f937-7b5c-43bd-9d41-2e0484619d5f"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:52:17.532385 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:52:17.538700 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-067629e7-2f23-41c8-912c-15249410c46f req-c94789dd-a2a1-44c3-947d-48be306130ac service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:17.539263 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-067629e7-2f23-41c8-912c-15249410c46f req-c94789dd-a2a1-44c3-947d-48be306130ac service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:17.539751 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-067629e7-2f23-41c8-912c-15249410c46f req-c94789dd-a2a1-44c3-947d-48be306130ac service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:17.555792 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-067629e7-2f23-41c8-912c-15249410c46f req-c94789dd-a2a1-44c3-947d-48be306130ac service nova] Creating event network-changed:54c7f937-7b5c-43bd-9d41-2e0484619d5f for instance 3d2b6fc4-0338-4141-9ac3-7b579718fae9 on hv-cinder-85220 Aug 18 14:52:17.561214 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-067629e7-2f23-41c8-912c-15249410c46f req-c94789dd-a2a1-44c3-947d-48be306130ac service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123032 Aug 18 14:52:17.563916 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 60/141] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:52:17.725508 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-e6afe1bf-79fb-473a-97a0-f7666c81fbf4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:17.726455 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-e6afe1bf-79fb-473a-97a0-f7666c81fbf4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:17.733109 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e6afe1bf-79fb-473a-97a0-f7666c81fbf4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:17.733967 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e6afe1bf-79fb-473a-97a0-f7666c81fbf4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:17.734465 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e6afe1bf-79fb-473a-97a0-f7666c81fbf4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:17.735333 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e6afe1bf-79fb-473a-97a0-f7666c81fbf4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:17.735989 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e6afe1bf-79fb-473a-97a0-f7666c81fbf4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:17.736415 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e6afe1bf-79fb-473a-97a0-f7666c81fbf4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:17.741139 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_cell1:SELECT=100 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:52:17.759232 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e65b99ab-f6ac-4a83-8ade-37baa8621483 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:17.760153 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e65b99ab-f6ac-4a83-8ade-37baa8621483 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:17.790443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e65b99ab-f6ac-4a83-8ade-37baa8621483 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:17.790945 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e65b99ab-f6ac-4a83-8ade-37baa8621483 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:17.791387 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e65b99ab-f6ac-4a83-8ade-37baa8621483 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:17.792230 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e65b99ab-f6ac-4a83-8ade-37baa8621483 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:17.793271 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e65b99ab-f6ac-4a83-8ade-37baa8621483 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:17.793707 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e65b99ab-f6ac-4a83-8ade-37baa8621483 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:18.045752 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-e6afe1bf-79fb-473a-97a0-f7666c81fbf4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:18.059933 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-e6afe1bf-79fb-473a-97a0-f7666c81fbf4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1362 microversion: 2.1 time: 0.338336 Aug 18 14:52:18.061944 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 82/142] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:17 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1362 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:18.068789 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e65b99ab-f6ac-4a83-8ade-37baa8621483 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:18.078899 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e65b99ab-f6ac-4a83-8ade-37baa8621483 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:18.081640 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e65b99ab-f6ac-4a83-8ade-37baa8621483 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:18.084619 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e65b99ab-f6ac-4a83-8ade-37baa8621483 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1407 microversion: 2.20 time: 0.330817 Aug 18 14:52:18.085862 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 61/143] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:17 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:52:18.442516 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-d9b9161a-95f6-4de6-8eb9-094684125de4 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:18.443888 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-d9b9161a-95f6-4de6-8eb9-094684125de4 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:18.456828 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-1a6a6c95-85d6-4b9e-97dc-d7b2429bb215 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:18.457630 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-1a6a6c95-85d6-4b9e-97dc-d7b2429bb215 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:18.458364 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d9b9161a-95f6-4de6-8eb9-094684125de4 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:18.459041 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d9b9161a-95f6-4de6-8eb9-094684125de4 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:18.460904 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d9b9161a-95f6-4de6-8eb9-094684125de4 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:18.463157 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d9b9161a-95f6-4de6-8eb9-094684125de4 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:18.464453 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d9b9161a-95f6-4de6-8eb9-094684125de4 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:18.464888 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d9b9161a-95f6-4de6-8eb9-094684125de4 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:18.476271 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1a6a6c95-85d6-4b9e-97dc-d7b2429bb215 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:18.482231 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1a6a6c95-85d6-4b9e-97dc-d7b2429bb215 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:18.482965 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1a6a6c95-85d6-4b9e-97dc-d7b2429bb215 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:18.485751 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1a6a6c95-85d6-4b9e-97dc-d7b2429bb215 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:18.488600 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1a6a6c95-85d6-4b9e-97dc-d7b2429bb215 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:18.490624 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1a6a6c95-85d6-4b9e-97dc-d7b2429bb215 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:19.118449 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-d9b9161a-95f6-4de6-8eb9-094684125de4 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:19.128085 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-d9b9161a-95f6-4de6-8eb9-094684125de4 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1501 microversion: 2.1 time: 0.689975 Aug 18 14:52:19.137006 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 83/144] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:18 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1501 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:19.142198 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-ccc17a88-c3c8-44d1-8911-3568faebf61e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:19.143048 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-ccc17a88-c3c8-44d1-8911-3568faebf61e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:19.144654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-1a6a6c95-85d6-4b9e-97dc-d7b2429bb215 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:19.151068 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ccc17a88-c3c8-44d1-8911-3568faebf61e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:19.152941 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-1a6a6c95-85d6-4b9e-97dc-d7b2429bb215 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1367 microversion: 2.1 time: 0.707298 Aug 18 14:52:19.153525 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 62/145] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:18 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1367 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:19.165416 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-541fbd6a-f51b-4b9e-b451-1f932791d65f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:19.166034 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-541fbd6a-f51b-4b9e-b451-1f932791d65f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:19.167099 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ccc17a88-c3c8-44d1-8911-3568faebf61e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:19.167715 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ccc17a88-c3c8-44d1-8911-3568faebf61e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:19.169072 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ccc17a88-c3c8-44d1-8911-3568faebf61e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:19.171171 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ccc17a88-c3c8-44d1-8911-3568faebf61e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:19.171658 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ccc17a88-c3c8-44d1-8911-3568faebf61e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:19.183331 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-541fbd6a-f51b-4b9e-b451-1f932791d65f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:19.183729 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-541fbd6a-f51b-4b9e-b451-1f932791d65f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:19.184331 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-541fbd6a-f51b-4b9e-b451-1f932791d65f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:19.185181 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-541fbd6a-f51b-4b9e-b451-1f932791d65f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:19.185785 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-541fbd6a-f51b-4b9e-b451-1f932791d65f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:19.186377 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-541fbd6a-f51b-4b9e-b451-1f932791d65f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:19.391371 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-541fbd6a-f51b-4b9e-b451-1f932791d65f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:19.402347 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-541fbd6a-f51b-4b9e-b451-1f932791d65f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:19.404159 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-541fbd6a-f51b-4b9e-b451-1f932791d65f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:19.404344 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-ccc17a88-c3c8-44d1-8911-3568faebf61e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:19.405282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-541fbd6a-f51b-4b9e-b451-1f932791d65f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1407 microversion: 2.20 time: 0.250855 Aug 18 14:52:19.414832 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-ccc17a88-c3c8-44d1-8911-3568faebf61e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1362 microversion: 2.1 time: 0.278954 Aug 18 14:52:19.419971 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 63/146] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:19 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:52:19.424783 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 84/147] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:19 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1362 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:19.580653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-533e06d7-573c-46ed-bf41-811265000f5d req-0b003a34-218c-4c85-ab0b-94fa6317c1ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89777120-9e0a-40d0-b71d-b73882a1a5e6", "tag": "7a3ee760-5357-4d9d-8a5c-1bb9ef667c23"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:52:19.589982 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-533e06d7-573c-46ed-bf41-811265000f5d req-0b003a34-218c-4c85-ab0b-94fa6317c1ea service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:19.590457 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-533e06d7-573c-46ed-bf41-811265000f5d req-0b003a34-218c-4c85-ab0b-94fa6317c1ea service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:19.590882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-533e06d7-573c-46ed-bf41-811265000f5d req-0b003a34-218c-4c85-ab0b-94fa6317c1ea service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:19.602046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-533e06d7-573c-46ed-bf41-811265000f5d req-0b003a34-218c-4c85-ab0b-94fa6317c1ea service nova] Creating event network-changed:7a3ee760-5357-4d9d-8a5c-1bb9ef667c23 for instance 89777120-9e0a-40d0-b71d-b73882a1a5e6 on hv-cinder-85220 Aug 18 14:52:19.607461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-533e06d7-573c-46ed-bf41-811265000f5d req-0b003a34-218c-4c85-ab0b-94fa6317c1ea service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030590 Aug 18 14:52:19.608105 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 64/148] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:52:20.178147 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-1d02a3d2-b6d9-4d01-9b2f-721080a6e40d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:20.179091 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-1d02a3d2-b6d9-4d01-9b2f-721080a6e40d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:20.186146 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1d02a3d2-b6d9-4d01-9b2f-721080a6e40d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:20.186727 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1d02a3d2-b6d9-4d01-9b2f-721080a6e40d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:20.187235 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1d02a3d2-b6d9-4d01-9b2f-721080a6e40d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:20.188061 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1d02a3d2-b6d9-4d01-9b2f-721080a6e40d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:20.188596 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1d02a3d2-b6d9-4d01-9b2f-721080a6e40d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:20.189283 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1d02a3d2-b6d9-4d01-9b2f-721080a6e40d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:20.328056 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-1d02a3d2-b6d9-4d01-9b2f-721080a6e40d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:20.335914 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-1d02a3d2-b6d9-4d01-9b2f-721080a6e40d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1367 microversion: 2.1 time: 0.161532 Aug 18 14:52:20.336501 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 85/149] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:20 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:20.429037 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-fe298281-71b8-414b-8823-a1a912d444b8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:20.429730 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-fe298281-71b8-414b-8823-a1a912d444b8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:20.436451 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fe298281-71b8-414b-8823-a1a912d444b8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:20.436927 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fe298281-71b8-414b-8823-a1a912d444b8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:20.437139 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-7b8e0f30-8814-44ca-867a-81bbb6cc47da tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:20.437342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fe298281-71b8-414b-8823-a1a912d444b8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:20.437717 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-7b8e0f30-8814-44ca-867a-81bbb6cc47da tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:20.438122 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fe298281-71b8-414b-8823-a1a912d444b8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:20.438563 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fe298281-71b8-414b-8823-a1a912d444b8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:20.438984 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fe298281-71b8-414b-8823-a1a912d444b8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:20.444104 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7b8e0f30-8814-44ca-867a-81bbb6cc47da tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:20.444587 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7b8e0f30-8814-44ca-867a-81bbb6cc47da tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:20.445019 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7b8e0f30-8814-44ca-867a-81bbb6cc47da tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:20.445716 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7b8e0f30-8814-44ca-867a-81bbb6cc47da tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:20.446165 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7b8e0f30-8814-44ca-867a-81bbb6cc47da tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:20.446583 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7b8e0f30-8814-44ca-867a-81bbb6cc47da tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:20.454871 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=100 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:52:20.805015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-fe298281-71b8-414b-8823-a1a912d444b8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:20.809327 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-7b8e0f30-8814-44ca-867a-81bbb6cc47da tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:20.814108 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-fe298281-71b8-414b-8823-a1a912d444b8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:20.815588 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-fe298281-71b8-414b-8823-a1a912d444b8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:20.816720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-fe298281-71b8-414b-8823-a1a912d444b8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1407 microversion: 2.20 time: 0.391988 Aug 18 14:52:20.816942 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-7b8e0f30-8814-44ca-867a-81bbb6cc47da tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1362 microversion: 2.1 time: 0.383661 Aug 18 14:52:20.817270 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 65/150] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:20 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1407 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:52:20.817500 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 86/151] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:20 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1362 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:52:21.357265 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ca9923c6-d29d-4ea2-9c3f-7b63d4ace3c3 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:21.357881 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ca9923c6-d29d-4ea2-9c3f-7b63d4ace3c3 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:21.363972 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ca9923c6-d29d-4ea2-9c3f-7b63d4ace3c3 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:21.364455 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ca9923c6-d29d-4ea2-9c3f-7b63d4ace3c3 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:21.364889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ca9923c6-d29d-4ea2-9c3f-7b63d4ace3c3 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:21.365583 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ca9923c6-d29d-4ea2-9c3f-7b63d4ace3c3 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:21.366037 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ca9923c6-d29d-4ea2-9c3f-7b63d4ace3c3 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:21.366489 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ca9923c6-d29d-4ea2-9c3f-7b63d4ace3c3 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:21.509036 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ca9923c6-d29d-4ea2-9c3f-7b63d4ace3c3 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:21.516719 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-ca9923c6-d29d-4ea2-9c3f-7b63d4ace3c3 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1367 microversion: 2.1 time: 0.163919 Aug 18 14:52:21.517283 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 66/152] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:21 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:21.837776 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-7dff114a-23cf-4d99-a928-d5eef05e2007 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:21.838421 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-7dff114a-23cf-4d99-a928-d5eef05e2007 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:21.841194 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_cell0:SELECT=2 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:52:21.847028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f9cff40d-2eed-44b0-92ec-1b6139011693 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:21.847633 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f9cff40d-2eed-44b0-92ec-1b6139011693 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:21.854931 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f9cff40d-2eed-44b0-92ec-1b6139011693 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:21.855576 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f9cff40d-2eed-44b0-92ec-1b6139011693 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:21.856142 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f9cff40d-2eed-44b0-92ec-1b6139011693 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:21.856245 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7dff114a-23cf-4d99-a928-d5eef05e2007 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:21.856666 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7dff114a-23cf-4d99-a928-d5eef05e2007 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:21.857098 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7dff114a-23cf-4d99-a928-d5eef05e2007 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:21.857272 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f9cff40d-2eed-44b0-92ec-1b6139011693 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:21.857796 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7dff114a-23cf-4d99-a928-d5eef05e2007 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:21.857908 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f9cff40d-2eed-44b0-92ec-1b6139011693 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:21.858240 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7dff114a-23cf-4d99-a928-d5eef05e2007 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:21.858340 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f9cff40d-2eed-44b0-92ec-1b6139011693 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:21.858651 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7dff114a-23cf-4d99-a928-d5eef05e2007 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:22.066164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f9cff40d-2eed-44b0-92ec-1b6139011693 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:22.069976 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-7dff114a-23cf-4d99-a928-d5eef05e2007 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:22.075395 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f9cff40d-2eed-44b0-92ec-1b6139011693 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:22.076916 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f9cff40d-2eed-44b0-92ec-1b6139011693 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:22.078303 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f9cff40d-2eed-44b0-92ec-1b6139011693 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1407 microversion: 2.20 time: 0.235155 Aug 18 14:52:22.078441 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-7dff114a-23cf-4d99-a928-d5eef05e2007 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1362 microversion: 2.1 time: 0.244723 Aug 18 14:52:22.078862 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 67/153] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:21 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:52:22.079416 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 87/154] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:21 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:22.537193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-691e8362-42eb-497e-8469-d4b8e172d40a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:22.538439 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-691e8362-42eb-497e-8469-d4b8e172d40a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:22.546567 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-691e8362-42eb-497e-8469-d4b8e172d40a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:22.547062 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-691e8362-42eb-497e-8469-d4b8e172d40a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:22.547497 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-691e8362-42eb-497e-8469-d4b8e172d40a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:22.548232 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-691e8362-42eb-497e-8469-d4b8e172d40a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:22.548766 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-691e8362-42eb-497e-8469-d4b8e172d40a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:22.549104 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-691e8362-42eb-497e-8469-d4b8e172d40a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:22.919344 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-691e8362-42eb-497e-8469-d4b8e172d40a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:22.929831 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-691e8362-42eb-497e-8469-d4b8e172d40a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1367 microversion: 2.1 time: 0.396415 Aug 18 14:52:22.930446 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 68/155] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:22 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1367 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:23.100543 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-f330afe5-fe5b-48be-9a26-28e9b83d83bf tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:23.101375 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-f330afe5-fe5b-48be-9a26-28e9b83d83bf tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:23.106407 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0750dbbc-8460-4b08-a8a6-f6257a81c143 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:23.107014 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0750dbbc-8460-4b08-a8a6-f6257a81c143 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:23.110480 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f330afe5-fe5b-48be-9a26-28e9b83d83bf tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:23.110970 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f330afe5-fe5b-48be-9a26-28e9b83d83bf tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:23.111399 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f330afe5-fe5b-48be-9a26-28e9b83d83bf tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:23.112123 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f330afe5-fe5b-48be-9a26-28e9b83d83bf tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:23.112573 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f330afe5-fe5b-48be-9a26-28e9b83d83bf tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:23.112988 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f330afe5-fe5b-48be-9a26-28e9b83d83bf tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:23.114465 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0750dbbc-8460-4b08-a8a6-f6257a81c143 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:23.114940 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0750dbbc-8460-4b08-a8a6-f6257a81c143 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:23.115362 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0750dbbc-8460-4b08-a8a6-f6257a81c143 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:23.116636 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0750dbbc-8460-4b08-a8a6-f6257a81c143 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:23.117019 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0750dbbc-8460-4b08-a8a6-f6257a81c143 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:23.117616 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0750dbbc-8460-4b08-a8a6-f6257a81c143 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:23.330805 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-f330afe5-fe5b-48be-9a26-28e9b83d83bf tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:23.337488 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-0750dbbc-8460-4b08-a8a6-f6257a81c143 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:23.349190 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-f330afe5-fe5b-48be-9a26-28e9b83d83bf tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1362 microversion: 2.1 time: 0.252598 Aug 18 14:52:23.351566 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-0750dbbc-8460-4b08-a8a6-f6257a81c143 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:23.351957 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 88/156] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:23 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:23.357142 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-0750dbbc-8460-4b08-a8a6-f6257a81c143 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:23.358576 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0750dbbc-8460-4b08-a8a6-f6257a81c143 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1407 microversion: 2.20 time: 0.259008 Aug 18 14:52:23.359579 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 69/157] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:23 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:52:23.740986 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-33d78201-156b-4033-b515-fa9964f15be3 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d560af3-9835-4f0c-87e9-3bd049384181"}} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:52:23.743363 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-33d78201-156b-4033-b515-fa9964f15be3 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:23.750348 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-33d78201-156b-4033-b515-fa9964f15be3 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:23.750833 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-33d78201-156b-4033-b515-fa9964f15be3 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:23.751262 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-33d78201-156b-4033-b515-fa9964f15be3 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:23.751993 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-33d78201-156b-4033-b515-fa9964f15be3 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:23.752447 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-33d78201-156b-4033-b515-fa9964f15be3 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:23.752869 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-33d78201-156b-4033-b515-fa9964f15be3 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:23.951351 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-39caa152-f1a1-442b-9c19-4b7dd2bf826a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:23.952116 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-39caa152-f1a1-442b-9c19-4b7dd2bf826a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:23.958079 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-39caa152-f1a1-442b-9c19-4b7dd2bf826a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:23.958640 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-39caa152-f1a1-442b-9c19-4b7dd2bf826a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:23.959132 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-39caa152-f1a1-442b-9c19-4b7dd2bf826a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:23.959940 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-39caa152-f1a1-442b-9c19-4b7dd2bf826a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:23.960565 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-39caa152-f1a1-442b-9c19-4b7dd2bf826a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:23.960982 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-39caa152-f1a1-442b-9c19-4b7dd2bf826a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:24.135987 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-39caa152-f1a1-442b-9c19-4b7dd2bf826a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:24.144342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-39caa152-f1a1-442b-9c19-4b7dd2bf826a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1367 microversion: 2.1 time: 0.197372 Aug 18 14:52:24.145071 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 70/158] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:23 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:52:24.371788 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-74f1144d-c96c-4cde-95f9-2f8162a8b5d6 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:24.372402 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-74f1144d-c96c-4cde-95f9-2f8162a8b5d6 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:24.378827 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74f1144d-c96c-4cde-95f9-2f8162a8b5d6 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:24.379298 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74f1144d-c96c-4cde-95f9-2f8162a8b5d6 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:24.379806 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74f1144d-c96c-4cde-95f9-2f8162a8b5d6 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:24.380577 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74f1144d-c96c-4cde-95f9-2f8162a8b5d6 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:24.381204 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74f1144d-c96c-4cde-95f9-2f8162a8b5d6 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:24.381624 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74f1144d-c96c-4cde-95f9-2f8162a8b5d6 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:24.578336 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-74f1144d-c96c-4cde-95f9-2f8162a8b5d6 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:24.586416 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-74f1144d-c96c-4cde-95f9-2f8162a8b5d6 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1362 microversion: 2.1 time: 0.219007 Aug 18 14:52:24.586997 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 71/159] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:24 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:52:24.600754 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-81d35c57-44fa-44c9-b685-3e132f377493 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:24.601646 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-81d35c57-44fa-44c9-b685-3e132f377493 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:24.609379 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-81d35c57-44fa-44c9-b685-3e132f377493 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:24.609926 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-81d35c57-44fa-44c9-b685-3e132f377493 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:24.610358 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-81d35c57-44fa-44c9-b685-3e132f377493 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:24.611066 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-81d35c57-44fa-44c9-b685-3e132f377493 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:24.611510 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-81d35c57-44fa-44c9-b685-3e132f377493 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:24.611953 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-81d35c57-44fa-44c9-b685-3e132f377493 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:24.748601 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-81d35c57-44fa-44c9-b685-3e132f377493 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:24.757402 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-81d35c57-44fa-44c9-b685-3e132f377493 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:24.758902 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-81d35c57-44fa-44c9-b685-3e132f377493 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:24.760063 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-81d35c57-44fa-44c9-b685-3e132f377493 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1407 microversion: 2.20 time: 0.163219 Aug 18 14:52:24.760598 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 72/160] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:24 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:52:25.169381 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-648addac-d501-4970-82f6-f9b0dabb0d01 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:25.169994 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-648addac-d501-4970-82f6-f9b0dabb0d01 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:25.176269 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-648addac-d501-4970-82f6-f9b0dabb0d01 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:25.176874 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-648addac-d501-4970-82f6-f9b0dabb0d01 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:25.177371 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-648addac-d501-4970-82f6-f9b0dabb0d01 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:25.178137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-648addac-d501-4970-82f6-f9b0dabb0d01 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:25.178735 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-648addac-d501-4970-82f6-f9b0dabb0d01 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:25.179162 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-648addac-d501-4970-82f6-f9b0dabb0d01 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:25.315738 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-648addac-d501-4970-82f6-f9b0dabb0d01 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:25.324287 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-648addac-d501-4970-82f6-f9b0dabb0d01 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1367 microversion: 2.1 time: 0.160399 Aug 18 14:52:25.325057 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 73/161] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:25 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:52:25.608193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-86cb8b3d-ff19-4063-ab95-4ef1159ffac4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:25.608814 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-86cb8b3d-ff19-4063-ab95-4ef1159ffac4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:25.615055 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-86cb8b3d-ff19-4063-ab95-4ef1159ffac4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:25.615876 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-86cb8b3d-ff19-4063-ab95-4ef1159ffac4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:25.616734 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-86cb8b3d-ff19-4063-ab95-4ef1159ffac4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:25.617615 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-86cb8b3d-ff19-4063-ab95-4ef1159ffac4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:25.618227 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-86cb8b3d-ff19-4063-ab95-4ef1159ffac4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:25.618834 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-86cb8b3d-ff19-4063-ab95-4ef1159ffac4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:25.891512 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-86cb8b3d-ff19-4063-ab95-4ef1159ffac4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:25.904876 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-86cb8b3d-ff19-4063-ab95-4ef1159ffac4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1362 microversion: 2.1 time: 0.301054 Aug 18 14:52:25.905533 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 74/162] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:25 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1362 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:52:25.914759 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b23fefc2-e71a-47b5-86f6-9b967a24a721 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:25.916148 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b23fefc2-e71a-47b5-86f6-9b967a24a721 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:25.925748 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b23fefc2-e71a-47b5-86f6-9b967a24a721 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:25.926637 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b23fefc2-e71a-47b5-86f6-9b967a24a721 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:25.927615 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b23fefc2-e71a-47b5-86f6-9b967a24a721 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:25.928372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b23fefc2-e71a-47b5-86f6-9b967a24a721 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:25.929171 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b23fefc2-e71a-47b5-86f6-9b967a24a721 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:25.929448 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b23fefc2-e71a-47b5-86f6-9b967a24a721 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:26.087518 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b23fefc2-e71a-47b5-86f6-9b967a24a721 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:26.098677 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b23fefc2-e71a-47b5-86f6-9b967a24a721 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:26.101161 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b23fefc2-e71a-47b5-86f6-9b967a24a721 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:26.102461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b23fefc2-e71a-47b5-86f6-9b967a24a721 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1407 microversion: 2.20 time: 0.192839 Aug 18 14:52:26.103274 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 75/163] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:25 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:52:26.120180 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-4025dd78-3d18-497d-a8b8-27c23808a2d5 req-8486c2b1-ff4f-43b8-9c2e-2de7f6339844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9d85d35-e080-4901-a147-87b0aaf6c5e5", "name": "network-vif-plugged", "status": "completed", "tag": "8ef940b0-b304-4979-ad53-fd987e997f5f"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:52:26.130382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-4025dd78-3d18-497d-a8b8-27c23808a2d5 req-8486c2b1-ff4f-43b8-9c2e-2de7f6339844 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:26.130858 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-4025dd78-3d18-497d-a8b8-27c23808a2d5 req-8486c2b1-ff4f-43b8-9c2e-2de7f6339844 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:26.131284 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-4025dd78-3d18-497d-a8b8-27c23808a2d5 req-8486c2b1-ff4f-43b8-9c2e-2de7f6339844 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:26.144162 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-4025dd78-3d18-497d-a8b8-27c23808a2d5 req-8486c2b1-ff4f-43b8-9c2e-2de7f6339844 service nova] Creating event network-vif-plugged:8ef940b0-b304-4979-ad53-fd987e997f5f for instance c9d85d35-e080-4901-a147-87b0aaf6c5e5 on hv-cinder-85220 Aug 18 14:52:26.149311 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-4025dd78-3d18-497d-a8b8-27c23808a2d5 req-8486c2b1-ff4f-43b8-9c2e-2de7f6339844 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045141 Aug 18 14:52:26.149910 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 76/164] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:52:26.346120 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-56d9b41f-523c-4024-998f-d3e704e2ac93 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:26.346908 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-56d9b41f-523c-4024-998f-d3e704e2ac93 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:26.353906 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-56d9b41f-523c-4024-998f-d3e704e2ac93 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:26.355436 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-56d9b41f-523c-4024-998f-d3e704e2ac93 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:26.355891 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-56d9b41f-523c-4024-998f-d3e704e2ac93 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:26.356646 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-56d9b41f-523c-4024-998f-d3e704e2ac93 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:26.357096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-56d9b41f-523c-4024-998f-d3e704e2ac93 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:26.357508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-56d9b41f-523c-4024-998f-d3e704e2ac93 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:26.490976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-56d9b41f-523c-4024-998f-d3e704e2ac93 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:26.499544 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-56d9b41f-523c-4024-998f-d3e704e2ac93 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1367 microversion: 2.1 time: 0.157584 Aug 18 14:52:26.500145 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 77/165] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:26 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:52:26.926361 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c8cfb3fa-e871-44f1-8aa2-d8c3a8ff470a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:26.927106 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c8cfb3fa-e871-44f1-8aa2-d8c3a8ff470a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:26.933564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c8cfb3fa-e871-44f1-8aa2-d8c3a8ff470a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:26.934058 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c8cfb3fa-e871-44f1-8aa2-d8c3a8ff470a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:26.934546 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c8cfb3fa-e871-44f1-8aa2-d8c3a8ff470a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:26.935250 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c8cfb3fa-e871-44f1-8aa2-d8c3a8ff470a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:26.935721 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c8cfb3fa-e871-44f1-8aa2-d8c3a8ff470a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:26.936143 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c8cfb3fa-e871-44f1-8aa2-d8c3a8ff470a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:27.078465 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c8cfb3fa-e871-44f1-8aa2-d8c3a8ff470a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:27.086026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c8cfb3fa-e871-44f1-8aa2-d8c3a8ff470a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1362 microversion: 2.1 time: 0.163831 Aug 18 14:52:27.086912 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 78/166] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:26 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:52:27.132756 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-6c8f545b-26d4-4cc2-80ca-3d4d7c9c0222 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:27.133367 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-6c8f545b-26d4-4cc2-80ca-3d4d7c9c0222 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:27.140939 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6c8f545b-26d4-4cc2-80ca-3d4d7c9c0222 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:27.141643 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6c8f545b-26d4-4cc2-80ca-3d4d7c9c0222 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:27.142215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6c8f545b-26d4-4cc2-80ca-3d4d7c9c0222 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:27.143103 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6c8f545b-26d4-4cc2-80ca-3d4d7c9c0222 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:27.143567 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6c8f545b-26d4-4cc2-80ca-3d4d7c9c0222 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:27.144024 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6c8f545b-26d4-4cc2-80ca-3d4d7c9c0222 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:27.284801 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6c8f545b-26d4-4cc2-80ca-3d4d7c9c0222 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:27.293190 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6c8f545b-26d4-4cc2-80ca-3d4d7c9c0222 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:27.294695 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6c8f545b-26d4-4cc2-80ca-3d4d7c9c0222 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:27.295832 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-6c8f545b-26d4-4cc2-80ca-3d4d7c9c0222 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1407 microversion: 2.20 time: 0.167320 Aug 18 14:52:27.296392 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 79/167] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:27 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:52:27.521692 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a515a155-72ba-470d-ac86-a83326c36493 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:27.522353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a515a155-72ba-470d-ac86-a83326c36493 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:27.529159 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a515a155-72ba-470d-ac86-a83326c36493 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:27.529644 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a515a155-72ba-470d-ac86-a83326c36493 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:27.530077 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a515a155-72ba-470d-ac86-a83326c36493 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:27.530774 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a515a155-72ba-470d-ac86-a83326c36493 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:27.531227 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a515a155-72ba-470d-ac86-a83326c36493 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:27.531643 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a515a155-72ba-470d-ac86-a83326c36493 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:27.694137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a515a155-72ba-470d-ac86-a83326c36493 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:27.703383 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a515a155-72ba-470d-ac86-a83326c36493 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1367 microversion: 2.1 time: 0.185621 Aug 18 14:52:27.703989 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 80/168] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:27 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:52:28.119556 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-7b7f1145-5b8e-4da6-9e88-ee26024fa749 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:28.120943 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-7b7f1145-5b8e-4da6-9e88-ee26024fa749 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:28.130152 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7b7f1145-5b8e-4da6-9e88-ee26024fa749 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:28.130669 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7b7f1145-5b8e-4da6-9e88-ee26024fa749 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:28.131099 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7b7f1145-5b8e-4da6-9e88-ee26024fa749 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:28.131830 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7b7f1145-5b8e-4da6-9e88-ee26024fa749 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:28.132547 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7b7f1145-5b8e-4da6-9e88-ee26024fa749 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:28.132968 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7b7f1145-5b8e-4da6-9e88-ee26024fa749 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:28.277095 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-7b7f1145-5b8e-4da6-9e88-ee26024fa749 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:28.285055 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-7b7f1145-5b8e-4da6-9e88-ee26024fa749 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1362 microversion: 2.1 time: 0.169209 Aug 18 14:52:28.285633 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 81/169] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:28 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:52:28.318760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-206e88cf-21c2-4aeb-a598-cb688a25a294 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:28.319349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-206e88cf-21c2-4aeb-a598-cb688a25a294 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:28.325386 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-206e88cf-21c2-4aeb-a598-cb688a25a294 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:28.325871 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-206e88cf-21c2-4aeb-a598-cb688a25a294 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:28.326302 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-206e88cf-21c2-4aeb-a598-cb688a25a294 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:28.326991 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-206e88cf-21c2-4aeb-a598-cb688a25a294 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:28.327439 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-206e88cf-21c2-4aeb-a598-cb688a25a294 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:28.327903 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-206e88cf-21c2-4aeb-a598-cb688a25a294 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:28.528703 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-206e88cf-21c2-4aeb-a598-cb688a25a294 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:28.531075 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=100 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:52:28.538377 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-206e88cf-21c2-4aeb-a598-cb688a25a294 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:28.539936 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-206e88cf-21c2-4aeb-a598-cb688a25a294 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:28.541063 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-206e88cf-21c2-4aeb-a598-cb688a25a294 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1407 microversion: 2.20 time: 0.226420 Aug 18 14:52:28.542277 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 82/170] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:28 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:52:28.726168 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-7bf344d2-0854-4a19-9cce-d2c0fe6518ae tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:28.726801 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-7bf344d2-0854-4a19-9cce-d2c0fe6518ae tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:28.735138 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7bf344d2-0854-4a19-9cce-d2c0fe6518ae tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:28.735630 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7bf344d2-0854-4a19-9cce-d2c0fe6518ae tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:28.736291 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7bf344d2-0854-4a19-9cce-d2c0fe6518ae tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:28.737233 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7bf344d2-0854-4a19-9cce-d2c0fe6518ae tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:28.738101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7bf344d2-0854-4a19-9cce-d2c0fe6518ae tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:28.739015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7bf344d2-0854-4a19-9cce-d2c0fe6518ae tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:28.895185 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-7bf344d2-0854-4a19-9cce-d2c0fe6518ae tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:28.904850 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-7bf344d2-0854-4a19-9cce-d2c0fe6518ae tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1367 microversion: 2.1 time: 0.182955 Aug 18 14:52:28.905615 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 83/171] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:28 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:52:29.306329 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-725f3198-b83b-4f75-b236-d4fc3d960ac6 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:29.306934 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-725f3198-b83b-4f75-b236-d4fc3d960ac6 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:29.313288 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-725f3198-b83b-4f75-b236-d4fc3d960ac6 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:29.313772 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-725f3198-b83b-4f75-b236-d4fc3d960ac6 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:29.314199 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-725f3198-b83b-4f75-b236-d4fc3d960ac6 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:29.314964 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-725f3198-b83b-4f75-b236-d4fc3d960ac6 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:29.315412 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-725f3198-b83b-4f75-b236-d4fc3d960ac6 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:29.315861 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-725f3198-b83b-4f75-b236-d4fc3d960ac6 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:29.637697 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-33d78201-156b-4033-b515-fa9964f15be3 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "POST /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.900409 Aug 18 14:52:29.645028 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 89/172] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Aug 18 14:52:23 2022] POST /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4/os-volume_attachments => generated 194 bytes in 5903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:52:29.683283 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-eab53d16-f877-4ab2-861c-8b864f6fb030 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:29.684294 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-eab53d16-f877-4ab2-861c-8b864f6fb030 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:29.704470 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_api:SELECT=82 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:52:29.719145 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-eab53d16-f877-4ab2-861c-8b864f6fb030 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:29.721862 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-eab53d16-f877-4ab2-861c-8b864f6fb030 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:29.723092 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-eab53d16-f877-4ab2-861c-8b864f6fb030 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:29.724874 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-eab53d16-f877-4ab2-861c-8b864f6fb030 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:29.726114 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-eab53d16-f877-4ab2-861c-8b864f6fb030 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:29.726114 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-eab53d16-f877-4ab2-861c-8b864f6fb030 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:30.157689 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-725f3198-b83b-4f75-b236-d4fc3d960ac6 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:30.179914 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-725f3198-b83b-4f75-b236-d4fc3d960ac6 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1362 microversion: 2.1 time: 0.877318 Aug 18 14:52:30.184745 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 84/173] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:29 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1362 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:52:30.199339 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-304a4a8f-4e95-4a75-b423-dcf609d4640c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:30.202054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-304a4a8f-4e95-4a75-b423-dcf609d4640c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:30.220691 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-304a4a8f-4e95-4a75-b423-dcf609d4640c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:30.221403 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-304a4a8f-4e95-4a75-b423-dcf609d4640c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:30.222728 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-304a4a8f-4e95-4a75-b423-dcf609d4640c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:30.223752 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-304a4a8f-4e95-4a75-b423-dcf609d4640c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:30.224514 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-304a4a8f-4e95-4a75-b423-dcf609d4640c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:30.227506 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-304a4a8f-4e95-4a75-b423-dcf609d4640c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:30.262649 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-eab53d16-f877-4ab2-861c-8b864f6fb030 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:30.278106 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-eab53d16-f877-4ab2-861c-8b864f6fb030 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:30.281359 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-eab53d16-f877-4ab2-861c-8b864f6fb030 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:30.284638 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-eab53d16-f877-4ab2-861c-8b864f6fb030 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1407 microversion: 2.20 time: 0.618036 Aug 18 14:52:30.292679 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 90/174] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:29 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1407 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:52:30.541051 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [req-2766f11f-3d87-4765-8e58-4b13072fd4b2 req-6f6a7dbf-33e7-4314-9465-1d8f895980f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89777120-9e0a-40d0-b71d-b73882a1a5e6", "name": "network-vif-plugged", "status": "completed", "tag": "7a3ee760-5357-4d9d-8a5c-1bb9ef667c23"}]} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:52:30.561180 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-2766f11f-3d87-4765-8e58-4b13072fd4b2 req-6f6a7dbf-33e7-4314-9465-1d8f895980f6 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:30.561674 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-2766f11f-3d87-4765-8e58-4b13072fd4b2 req-6f6a7dbf-33e7-4314-9465-1d8f895980f6 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:30.563550 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-2766f11f-3d87-4765-8e58-4b13072fd4b2 req-6f6a7dbf-33e7-4314-9465-1d8f895980f6 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:30.573124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-304a4a8f-4e95-4a75-b423-dcf609d4640c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:30.576005 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.compute.server_external_events [req-2766f11f-3d87-4765-8e58-4b13072fd4b2 req-6f6a7dbf-33e7-4314-9465-1d8f895980f6 service nova] Creating event network-vif-plugged:7a3ee760-5357-4d9d-8a5c-1bb9ef667c23 for instance 89777120-9e0a-40d0-b71d-b73882a1a5e6 on hv-cinder-85220 Aug 18 14:52:30.581335 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [req-2766f11f-3d87-4765-8e58-4b13072fd4b2 req-6f6a7dbf-33e7-4314-9465-1d8f895980f6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044127 Aug 18 14:52:30.581683 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-304a4a8f-4e95-4a75-b423-dcf609d4640c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1367 microversion: 2.1 time: 0.395591 Aug 18 14:52:30.582393 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 91/175] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:52:30.584135 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 85/176] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:30 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1367 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:31.206972 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-0b0a7773-5188-44e2-970e-90e9112ec994 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:31.207625 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-0b0a7773-5188-44e2-970e-90e9112ec994 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:31.214063 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0b0a7773-5188-44e2-970e-90e9112ec994 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:31.214455 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0b0a7773-5188-44e2-970e-90e9112ec994 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:31.214885 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0b0a7773-5188-44e2-970e-90e9112ec994 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:31.215576 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0b0a7773-5188-44e2-970e-90e9112ec994 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:31.216076 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0b0a7773-5188-44e2-970e-90e9112ec994 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:31.216491 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0b0a7773-5188-44e2-970e-90e9112ec994 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:31.320969 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5a949dae-c8f8-4ece-a344-ea2f419e0efc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:31.326423 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-5a949dae-c8f8-4ece-a344-ea2f419e0efc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:31.333483 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5a949dae-c8f8-4ece-a344-ea2f419e0efc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:31.334489 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5a949dae-c8f8-4ece-a344-ea2f419e0efc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:31.335120 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5a949dae-c8f8-4ece-a344-ea2f419e0efc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:31.336686 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5a949dae-c8f8-4ece-a344-ea2f419e0efc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:31.337336 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5a949dae-c8f8-4ece-a344-ea2f419e0efc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:31.337944 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5a949dae-c8f8-4ece-a344-ea2f419e0efc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:31.366879 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-0b0a7773-5188-44e2-970e-90e9112ec994 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:31.377954 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-0b0a7773-5188-44e2-970e-90e9112ec994 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1362 microversion: 2.1 time: 0.175173 Aug 18 14:52:31.383709 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 92/177] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:31 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:31.511567 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-5a949dae-c8f8-4ece-a344-ea2f419e0efc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:31.521154 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-5a949dae-c8f8-4ece-a344-ea2f419e0efc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:31.522937 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-5a949dae-c8f8-4ece-a344-ea2f419e0efc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:31.524262 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-5a949dae-c8f8-4ece-a344-ea2f419e0efc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1407 microversion: 2.20 time: 0.208357 Aug 18 14:52:31.525236 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 86/178] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:31 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:52:31.609479 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-e21dbdb1-85b5-4882-b086-7035749584ba tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:31.610137 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-e21dbdb1-85b5-4882-b086-7035749584ba tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:31.617352 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e21dbdb1-85b5-4882-b086-7035749584ba tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:31.617827 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e21dbdb1-85b5-4882-b086-7035749584ba tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:31.618255 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e21dbdb1-85b5-4882-b086-7035749584ba tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:31.619118 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e21dbdb1-85b5-4882-b086-7035749584ba tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:31.619860 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e21dbdb1-85b5-4882-b086-7035749584ba tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:31.620288 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e21dbdb1-85b5-4882-b086-7035749584ba tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:31.897315 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-e21dbdb1-85b5-4882-b086-7035749584ba tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:31.907297 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-e21dbdb1-85b5-4882-b086-7035749584ba tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1367 microversion: 2.1 time: 0.302076 Aug 18 14:52:31.911980 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 93/179] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:31 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:32.409339 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-9aebaf5f-588a-4242-abef-a4cc5c43c053 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:32.412753 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-9aebaf5f-588a-4242-abef-a4cc5c43c053 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:32.427770 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9aebaf5f-588a-4242-abef-a4cc5c43c053 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:32.428311 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9aebaf5f-588a-4242-abef-a4cc5c43c053 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:32.428737 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9aebaf5f-588a-4242-abef-a4cc5c43c053 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:32.433843 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9aebaf5f-588a-4242-abef-a4cc5c43c053 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:32.435153 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9aebaf5f-588a-4242-abef-a4cc5c43c053 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:32.435824 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9aebaf5f-588a-4242-abef-a4cc5c43c053 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:32.549324 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-68accb91-ec17-4c45-84e1-000862cf1fac tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:32.551015 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-68accb91-ec17-4c45-84e1-000862cf1fac tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:32.561771 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-68accb91-ec17-4c45-84e1-000862cf1fac tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:32.562274 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-68accb91-ec17-4c45-84e1-000862cf1fac tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:32.562873 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-68accb91-ec17-4c45-84e1-000862cf1fac tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:32.563802 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-68accb91-ec17-4c45-84e1-000862cf1fac tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:32.564422 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-68accb91-ec17-4c45-84e1-000862cf1fac tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:32.565423 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-68accb91-ec17-4c45-84e1-000862cf1fac tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:32.875349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-9aebaf5f-588a-4242-abef-a4cc5c43c053 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:32.890364 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-9aebaf5f-588a-4242-abef-a4cc5c43c053 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1548 microversion: 2.1 time: 0.493236 Aug 18 14:52:32.917707 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 87/180] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:32 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1548 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:32.930667 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-11297d20-592f-4dff-9518-6d54be01d58a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:32.931281 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-11297d20-592f-4dff-9518-6d54be01d58a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:32.938602 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-11297d20-592f-4dff-9518-6d54be01d58a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:32.939354 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-68accb91-ec17-4c45-84e1-000862cf1fac tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:32.939485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-11297d20-592f-4dff-9518-6d54be01d58a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:32.939927 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-11297d20-592f-4dff-9518-6d54be01d58a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:32.940878 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-11297d20-592f-4dff-9518-6d54be01d58a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:32.941413 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-11297d20-592f-4dff-9518-6d54be01d58a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:32.942284 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-11297d20-592f-4dff-9518-6d54be01d58a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:32.954873 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-68accb91-ec17-4c45-84e1-000862cf1fac tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:32.956411 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-68accb91-ec17-4c45-84e1-000862cf1fac tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:32.957559 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-68accb91-ec17-4c45-84e1-000862cf1fac tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1407 microversion: 2.20 time: 0.414356 Aug 18 14:52:32.973797 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 94/181] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:32 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1407 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:52:32.978728 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-410aff57-4d99-408f-a231-836043503615 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:32.979942 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-410aff57-4d99-408f-a231-836043503615 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:32.985942 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-410aff57-4d99-408f-a231-836043503615 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:32.986418 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-410aff57-4d99-408f-a231-836043503615 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:32.987056 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-410aff57-4d99-408f-a231-836043503615 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:32.987787 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-410aff57-4d99-408f-a231-836043503615 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:32.989611 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-410aff57-4d99-408f-a231-836043503615 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:32.989611 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-410aff57-4d99-408f-a231-836043503615 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:33.128786 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-11297d20-592f-4dff-9518-6d54be01d58a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.201987 Aug 18 14:52:33.133091 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 88/182] 10.222.0.36 () {58 vars in 1275 bytes} [Thu Aug 18 14:52:32 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5/os-interface => generated 284 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:52:33.413244 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-410aff57-4d99-408f-a231-836043503615 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:33.429293 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-410aff57-4d99-408f-a231-836043503615 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1367 microversion: 2.1 time: 0.454294 Aug 18 14:52:33.430452 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 95/183] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:32 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1367 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:33.993207 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d4b795e8-7828-47d5-b011-b7a0fb3f0872 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:33.994045 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d4b795e8-7828-47d5-b011-b7a0fb3f0872 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:34.010572 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d4b795e8-7828-47d5-b011-b7a0fb3f0872 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:34.011078 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d4b795e8-7828-47d5-b011-b7a0fb3f0872 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:34.011520 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d4b795e8-7828-47d5-b011-b7a0fb3f0872 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:34.012322 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d4b795e8-7828-47d5-b011-b7a0fb3f0872 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:34.012783 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d4b795e8-7828-47d5-b011-b7a0fb3f0872 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:34.013223 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d4b795e8-7828-47d5-b011-b7a0fb3f0872 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:34.436212 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [req-8acdf02c-8899-49bd-9899-5a99ad6d3c95 req-bc3aa6ff-ef8a-4fbf-a029-7dacd4a6ccc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2b6fc4-0338-4141-9ac3-7b579718fae9", "name": "network-vif-plugged", "status": "completed", "tag": "54c7f937-7b5c-43bd-9d41-2e0484619d5f"}]} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:52:34.464347 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-8acdf02c-8899-49bd-9899-5a99ad6d3c95 req-bc3aa6ff-ef8a-4fbf-a029-7dacd4a6ccc6 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:34.471075 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-8acdf02c-8899-49bd-9899-5a99ad6d3c95 req-bc3aa6ff-ef8a-4fbf-a029-7dacd4a6ccc6 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:34.473038 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-8acdf02c-8899-49bd-9899-5a99ad6d3c95 req-bc3aa6ff-ef8a-4fbf-a029-7dacd4a6ccc6 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:34.493469 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.compute.server_external_events [req-8acdf02c-8899-49bd-9899-5a99ad6d3c95 req-bc3aa6ff-ef8a-4fbf-a029-7dacd4a6ccc6 service nova] Creating event network-vif-plugged:54c7f937-7b5c-43bd-9d41-2e0484619d5f for instance 3d2b6fc4-0338-4141-9ac3-7b579718fae9 on hv-cinder-85220 Aug 18 14:52:34.501832 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [req-8acdf02c-8899-49bd-9899-5a99ad6d3c95 req-bc3aa6ff-ef8a-4fbf-a029-7dacd4a6ccc6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070114 Aug 18 14:52:34.502964 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 96/184] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:52:34.509988 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-e937f6d0-0c5d-45f6-81a4-a24c142c2c5d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:34.511524 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-e937f6d0-0c5d-45f6-81a4-a24c142c2c5d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:34.580053 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e937f6d0-0c5d-45f6-81a4-a24c142c2c5d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:34.580519 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e937f6d0-0c5d-45f6-81a4-a24c142c2c5d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:34.584154 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e937f6d0-0c5d-45f6-81a4-a24c142c2c5d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:34.592020 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e937f6d0-0c5d-45f6-81a4-a24c142c2c5d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:34.598254 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e937f6d0-0c5d-45f6-81a4-a24c142c2c5d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:34.600526 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e937f6d0-0c5d-45f6-81a4-a24c142c2c5d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:34.724304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d4b795e8-7828-47d5-b011-b7a0fb3f0872 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:34.740790 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d4b795e8-7828-47d5-b011-b7a0fb3f0872 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:34.742295 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d4b795e8-7828-47d5-b011-b7a0fb3f0872 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:34.751617 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d4b795e8-7828-47d5-b011-b7a0fb3f0872 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1407 microversion: 2.20 time: 0.766239 Aug 18 14:52:34.751617 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 89/185] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:33 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1407 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:52:34.996750 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-e937f6d0-0c5d-45f6-81a4-a24c142c2c5d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:35.008701 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-e937f6d0-0c5d-45f6-81a4-a24c142c2c5d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1558 microversion: 2.1 time: 0.504480 Aug 18 14:52:35.009725 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 97/186] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:34 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1558 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:35.037134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b285b53b-f37f-4ff3-90f4-5ec9130952eb tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:35.038514 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b285b53b-f37f-4ff3-90f4-5ec9130952eb tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:35.046077 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b285b53b-f37f-4ff3-90f4-5ec9130952eb tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:35.046799 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b285b53b-f37f-4ff3-90f4-5ec9130952eb tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:35.047444 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b285b53b-f37f-4ff3-90f4-5ec9130952eb tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:35.048850 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b285b53b-f37f-4ff3-90f4-5ec9130952eb tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:35.049501 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b285b53b-f37f-4ff3-90f4-5ec9130952eb tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:35.050638 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b285b53b-f37f-4ff3-90f4-5ec9130952eb tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:35.266652 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b285b53b-f37f-4ff3-90f4-5ec9130952eb tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.235843 Aug 18 14:52:35.268312 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 90/187] 10.222.0.36 () {58 vars in 1275 bytes} [Thu Aug 18 14:52:35 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6/os-interface => generated 285 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:52:35.654545 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [req-cf761c68-f457-4bd4-b299-6cb4459693b0 req-f0601a26-dda5-4079-9e6b-8e43260e159d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9d85d35-e080-4901-a147-87b0aaf6c5e5", "tag": "8ef940b0-b304-4979-ad53-fd987e997f5f"}]} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:52:35.676270 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-cf761c68-f457-4bd4-b299-6cb4459693b0 req-f0601a26-dda5-4079-9e6b-8e43260e159d service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:35.676948 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-cf761c68-f457-4bd4-b299-6cb4459693b0 req-f0601a26-dda5-4079-9e6b-8e43260e159d service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:35.679574 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-cf761c68-f457-4bd4-b299-6cb4459693b0 req-f0601a26-dda5-4079-9e6b-8e43260e159d service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:35.705120 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.compute.server_external_events [req-cf761c68-f457-4bd4-b299-6cb4459693b0 req-f0601a26-dda5-4079-9e6b-8e43260e159d service nova] Creating event network-changed:8ef940b0-b304-4979-ad53-fd987e997f5f for instance c9d85d35-e080-4901-a147-87b0aaf6c5e5 on hv-cinder-85220 Aug 18 14:52:35.714781 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [req-cf761c68-f457-4bd4-b299-6cb4459693b0 req-f0601a26-dda5-4079-9e6b-8e43260e159d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066327 Aug 18 14:52:35.728787 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 98/188] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:52:35.779559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d6454f6c-8861-443e-bdea-ffc674e923a1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:35.780241 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d6454f6c-8861-443e-bdea-ffc674e923a1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:35.792502 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d6454f6c-8861-443e-bdea-ffc674e923a1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:35.793277 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d6454f6c-8861-443e-bdea-ffc674e923a1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:35.793707 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d6454f6c-8861-443e-bdea-ffc674e923a1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:35.795539 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d6454f6c-8861-443e-bdea-ffc674e923a1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:35.796872 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d6454f6c-8861-443e-bdea-ffc674e923a1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:35.797493 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d6454f6c-8861-443e-bdea-ffc674e923a1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:36.141144 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d6454f6c-8861-443e-bdea-ffc674e923a1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:36.155806 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d6454f6c-8861-443e-bdea-ffc674e923a1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:36.157600 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d6454f6c-8861-443e-bdea-ffc674e923a1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:36.164794 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d6454f6c-8861-443e-bdea-ffc674e923a1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1407 microversion: 2.20 time: 0.390990 Aug 18 14:52:36.166160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 91/189] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:35 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1407 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:52:37.192811 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-57d2d1c1-03c0-4de5-82e9-9d7e67464734 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:37.193567 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-57d2d1c1-03c0-4de5-82e9-9d7e67464734 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:37.201815 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-57d2d1c1-03c0-4de5-82e9-9d7e67464734 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:37.202321 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-57d2d1c1-03c0-4de5-82e9-9d7e67464734 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:37.202769 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-57d2d1c1-03c0-4de5-82e9-9d7e67464734 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:37.203484 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-57d2d1c1-03c0-4de5-82e9-9d7e67464734 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:37.203973 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-57d2d1c1-03c0-4de5-82e9-9d7e67464734 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:37.204401 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-57d2d1c1-03c0-4de5-82e9-9d7e67464734 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:37.221962 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:52:37.438541 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-57d2d1c1-03c0-4de5-82e9-9d7e67464734 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:37.452327 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-57d2d1c1-03c0-4de5-82e9-9d7e67464734 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:37.456284 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-57d2d1c1-03c0-4de5-82e9-9d7e67464734 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:37.457480 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-57d2d1c1-03c0-4de5-82e9-9d7e67464734 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1407 microversion: 2.20 time: 0.269687 Aug 18 14:52:37.476971 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 99/190] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:37 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1407 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:52:37.931721 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-d0b71bb5-1e5b-4629-9811-6b4f7978deb4 req-e96e1e47-0eb8-49fb-8a9a-502ad2874a82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89777120-9e0a-40d0-b71d-b73882a1a5e6", "tag": "7a3ee760-5357-4d9d-8a5c-1bb9ef667c23"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:52:37.952593 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-d0b71bb5-1e5b-4629-9811-6b4f7978deb4 req-e96e1e47-0eb8-49fb-8a9a-502ad2874a82 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:37.955872 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-d0b71bb5-1e5b-4629-9811-6b4f7978deb4 req-e96e1e47-0eb8-49fb-8a9a-502ad2874a82 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:37.959042 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-d0b71bb5-1e5b-4629-9811-6b4f7978deb4 req-e96e1e47-0eb8-49fb-8a9a-502ad2874a82 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:37.982698 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-d0b71bb5-1e5b-4629-9811-6b4f7978deb4 req-e96e1e47-0eb8-49fb-8a9a-502ad2874a82 service nova] Creating event network-changed:7a3ee760-5357-4d9d-8a5c-1bb9ef667c23 for instance 89777120-9e0a-40d0-b71d-b73882a1a5e6 on hv-cinder-85220 Aug 18 14:52:37.992977 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-d0b71bb5-1e5b-4629-9811-6b4f7978deb4 req-e96e1e47-0eb8-49fb-8a9a-502ad2874a82 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068524 Aug 18 14:52:38.000501 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 92/191] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:52:38.487042 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-1cab41cb-dc32-494d-aa99-eed20c2692c8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:38.488132 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-1cab41cb-dc32-494d-aa99-eed20c2692c8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:38.501445 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1cab41cb-dc32-494d-aa99-eed20c2692c8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:38.504233 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1cab41cb-dc32-494d-aa99-eed20c2692c8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:38.504833 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1cab41cb-dc32-494d-aa99-eed20c2692c8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:38.505714 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1cab41cb-dc32-494d-aa99-eed20c2692c8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:38.508152 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1cab41cb-dc32-494d-aa99-eed20c2692c8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:38.508580 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1cab41cb-dc32-494d-aa99-eed20c2692c8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:38.758380 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-1cab41cb-dc32-494d-aa99-eed20c2692c8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:38.770363 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-1cab41cb-dc32-494d-aa99-eed20c2692c8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:38.772589 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-1cab41cb-dc32-494d-aa99-eed20c2692c8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:38.774837 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-1cab41cb-dc32-494d-aa99-eed20c2692c8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1599 microversion: 2.20 time: 0.293899 Aug 18 14:52:38.776682 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 100/192] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:52:38 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1599 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:52:38.804954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-38c09e7d-1c0c-453f-a9fb-50eac071187d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:38.806068 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-38c09e7d-1c0c-453f-a9fb-50eac071187d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:38.814868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-38c09e7d-1c0c-453f-a9fb-50eac071187d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:38.815550 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-38c09e7d-1c0c-453f-a9fb-50eac071187d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:38.816062 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-38c09e7d-1c0c-453f-a9fb-50eac071187d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:38.816988 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-38c09e7d-1c0c-453f-a9fb-50eac071187d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:38.817641 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-38c09e7d-1c0c-453f-a9fb-50eac071187d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:38.818064 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-38c09e7d-1c0c-453f-a9fb-50eac071187d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:39.141869 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-38c09e7d-1c0c-453f-a9fb-50eac071187d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.342000 Aug 18 14:52:39.142816 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 93/193] 10.222.0.36 () {60 vars in 1316 bytes} [Thu Aug 18 14:52:38 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9/os-interface => generated 285 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:52:40.439104 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-e88608f0-ca96-4a60-8133-50ff0d87eff4 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:40.439649 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-e88608f0-ca96-4a60-8133-50ff0d87eff4 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:40.452762 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e88608f0-ca96-4a60-8133-50ff0d87eff4 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:40.453262 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e88608f0-ca96-4a60-8133-50ff0d87eff4 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:40.453688 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e88608f0-ca96-4a60-8133-50ff0d87eff4 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:40.454391 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e88608f0-ca96-4a60-8133-50ff0d87eff4 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:40.454854 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e88608f0-ca96-4a60-8133-50ff0d87eff4 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:40.455263 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e88608f0-ca96-4a60-8133-50ff0d87eff4 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:40.502643 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-e88608f0-ca96-4a60-8133-50ff0d87eff4 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Going to try to terminate instance {{(pid=132267) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:52:40.690215 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-e88608f0-ca96-4a60-8133-50ff0d87eff4 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 204 len: 0 microversion: 2.1 time: 0.254236 Aug 18 14:52:40.691246 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 101/194] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 14:52:40 2022] DELETE /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:52:40.700645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f40f36e4-fc07-4463-a2e9-0cd5b316e3e1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:40.701356 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f40f36e4-fc07-4463-a2e9-0cd5b316e3e1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:40.715789 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f40f36e4-fc07-4463-a2e9-0cd5b316e3e1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:40.715789 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f40f36e4-fc07-4463-a2e9-0cd5b316e3e1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:40.715789 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f40f36e4-fc07-4463-a2e9-0cd5b316e3e1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:40.715789 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f40f36e4-fc07-4463-a2e9-0cd5b316e3e1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:40.716375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f40f36e4-fc07-4463-a2e9-0cd5b316e3e1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:40.716375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f40f36e4-fc07-4463-a2e9-0cd5b316e3e1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:40.902837 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [req-61d74bdf-951b-4f34-8227-1645a2dcc9fa req-b5de5f3d-d58e-4789-9732-b828e14a8f00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d2b6fc4-0338-4141-9ac3-7b579718fae9", "tag": "54c7f937-7b5c-43bd-9d41-2e0484619d5f"}]} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:52:40.913566 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f40f36e4-fc07-4463-a2e9-0cd5b316e3e1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:40.919957 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-61d74bdf-951b-4f34-8227-1645a2dcc9fa req-b5de5f3d-d58e-4789-9732-b828e14a8f00 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:40.920425 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-61d74bdf-951b-4f34-8227-1645a2dcc9fa req-b5de5f3d-d58e-4789-9732-b828e14a8f00 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:40.920848 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-61d74bdf-951b-4f34-8227-1645a2dcc9fa req-b5de5f3d-d58e-4789-9732-b828e14a8f00 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:40.928648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f40f36e4-fc07-4463-a2e9-0cd5b316e3e1 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1553 microversion: 2.1 time: 0.232904 Aug 18 14:52:40.929224 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 94/195] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:40 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1553 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:40.941323 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.compute.server_external_events [req-61d74bdf-951b-4f34-8227-1645a2dcc9fa req-b5de5f3d-d58e-4789-9732-b828e14a8f00 service nova] Creating event network-changed:54c7f937-7b5c-43bd-9d41-2e0484619d5f for instance 3d2b6fc4-0338-4141-9ac3-7b579718fae9 on hv-cinder-85220 Aug 18 14:52:40.947301 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [req-61d74bdf-951b-4f34-8227-1645a2dcc9fa req-b5de5f3d-d58e-4789-9732-b828e14a8f00 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049228 Aug 18 14:52:40.948014 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 102/196] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:52:41.955435 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-11f0a759-f67f-414f-b702-41aea6214b3d tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:41.962356 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-11f0a759-f67f-414f-b702-41aea6214b3d tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:41.971354 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-11f0a759-f67f-414f-b702-41aea6214b3d tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:41.972350 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-11f0a759-f67f-414f-b702-41aea6214b3d tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:41.974523 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-11f0a759-f67f-414f-b702-41aea6214b3d tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:41.977000 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-11f0a759-f67f-414f-b702-41aea6214b3d tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:41.977651 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-11f0a759-f67f-414f-b702-41aea6214b3d tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:41.980498 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-11f0a759-f67f-414f-b702-41aea6214b3d tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:42.261899 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-11f0a759-f67f-414f-b702-41aea6214b3d tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:42.299026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-11f0a759-f67f-414f-b702-41aea6214b3d tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1553 microversion: 2.1 time: 0.348546 Aug 18 14:52:42.299714 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 95/197] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:41 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1553 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:43.323661 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-1f70ee0d-a4fb-4f5c-9b8a-2fe51ed6556a tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:43.324384 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-1f70ee0d-a4fb-4f5c-9b8a-2fe51ed6556a tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:43.335640 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1f70ee0d-a4fb-4f5c-9b8a-2fe51ed6556a tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:43.336161 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1f70ee0d-a4fb-4f5c-9b8a-2fe51ed6556a tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:43.336595 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1f70ee0d-a4fb-4f5c-9b8a-2fe51ed6556a tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:43.337311 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1f70ee0d-a4fb-4f5c-9b8a-2fe51ed6556a tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:43.337767 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1f70ee0d-a4fb-4f5c-9b8a-2fe51ed6556a tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:43.338227 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1f70ee0d-a4fb-4f5c-9b8a-2fe51ed6556a tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:44.092568 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-1f70ee0d-a4fb-4f5c-9b8a-2fe51ed6556a tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:44.113470 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-1f70ee0d-a4fb-4f5c-9b8a-2fe51ed6556a tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1553 microversion: 2.1 time: 0.795296 Aug 18 14:52:44.117361 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 103/198] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:43 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1553 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:44.798220 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-ce51c6de-f3eb-4321-9c61-20d81866484e req-b42c46d3-6de4-44c8-9199-4b6fecd529fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aa2e996-a18b-49a2-8456-afb00be537d4", "name": "network-vif-deleted", "tag": "bfa6223e-f2cb-4716-b5bd-450125b52439"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:52:44.812936 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-ce51c6de-f3eb-4321-9c61-20d81866484e req-b42c46d3-6de4-44c8-9199-4b6fecd529fb service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:44.818176 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-ce51c6de-f3eb-4321-9c61-20d81866484e req-b42c46d3-6de4-44c8-9199-4b6fecd529fb service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:44.819127 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-ce51c6de-f3eb-4321-9c61-20d81866484e req-b42c46d3-6de4-44c8-9199-4b6fecd529fb service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:44.835380 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-ce51c6de-f3eb-4321-9c61-20d81866484e req-b42c46d3-6de4-44c8-9199-4b6fecd529fb service nova] Creating event network-vif-deleted:bfa6223e-f2cb-4716-b5bd-450125b52439 for instance 5aa2e996-a18b-49a2-8456-afb00be537d4 on hv-cinder-85220 Aug 18 14:52:44.843882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-ce51c6de-f3eb-4321-9c61-20d81866484e req-b42c46d3-6de4-44c8-9199-4b6fecd529fb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048994 Aug 18 14:52:44.845445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 96/199] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:52:45.148404 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-78b57f11-598a-44dc-850b-2c21a77e4325 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:45.149848 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-78b57f11-598a-44dc-850b-2c21a77e4325 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:45.158757 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-78b57f11-598a-44dc-850b-2c21a77e4325 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:45.160260 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-78b57f11-598a-44dc-850b-2c21a77e4325 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:45.161214 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-78b57f11-598a-44dc-850b-2c21a77e4325 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:45.162278 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-78b57f11-598a-44dc-850b-2c21a77e4325 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:45.163105 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-78b57f11-598a-44dc-850b-2c21a77e4325 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:45.163755 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-78b57f11-598a-44dc-850b-2c21a77e4325 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:45.286947 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-78b57f11-598a-44dc-850b-2c21a77e4325 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1469a960bd9241008cfb112a28bcd5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a38dab41aca4c2d9258599840ce93d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:45.301888 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-78b57f11-598a-44dc-850b-2c21a77e4325 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 200 len: 1345 microversion: 2.1 time: 0.164017 Aug 18 14:52:45.309354 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 104/200] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:45 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 1345 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:46.335049 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-7f1afbb0-8d89-4deb-9ef6-26c770c58742 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:46.336235 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-7f1afbb0-8d89-4deb-9ef6-26c770c58742 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:46.349916 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7f1afbb0-8d89-4deb-9ef6-26c770c58742 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:46.350479 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7f1afbb0-8d89-4deb-9ef6-26c770c58742 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:46.351172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7f1afbb0-8d89-4deb-9ef6-26c770c58742 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:46.352681 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7f1afbb0-8d89-4deb-9ef6-26c770c58742 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:46.355129 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7f1afbb0-8d89-4deb-9ef6-26c770c58742 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:46.355895 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7f1afbb0-8d89-4deb-9ef6-26c770c58742 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:46.410556 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-7f1afbb0-8d89-4deb-9ef6-26c770c58742 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] HTTP exception thrown: Instance 5aa2e996-a18b-49a2-8456-afb00be537d4 could not be found. Aug 18 14:52:46.430897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-7f1afbb0-8d89-4deb-9ef6-26c770c58742 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Request method failure captured: Aug 18 14:52:46.430897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 HTTP/1.1 Aug 18 14:52:46.430897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:52:46.430897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:52:46.430897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:52:46.430897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:52:46.430897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:52:46.430897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:52:46.430897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:52:46.430897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:52:46.430897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lHvoYzlu_82afzH-T9DMR6XiJTLrlCMg-kgAzokLIQ00LhEPQM_VBu6-JkDumPcL0dgb-mkGHtdafCYyAJplfuZ6DqkPy1kdujivQ_X6qEnxba8u9GYvZTim7x5QZ-ePhAyL0UNjtf1SuYRKGqj2TPr0c6dMb0Y4piEJ6tkvNjKLg4 Aug 18 14:52:46.430897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:52:46.430897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:52:46.430897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:52:46.430897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:52:46.430897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:52:46.430897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:52:46.430897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: 2a38dab41aca4c2d9258599840ce93d5 Aug 18 14:52:46.430897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-DeleteServersTestJSON-247058038 Aug 18 14:52:46.430897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:52:46.430897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:52:46.433314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a38dab41aca4c2d9258599840ce93d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a38dab41aca4c2d9258599840ce93d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2a38dab41aca4c2d9258599840ce93d5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2a38dab41aca4c2d9258599840ce93d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:52:46.433314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-DeleteServersTestJSON-247058038 Aug 18 14:52:46.433314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: 2a38dab41aca4c2d9258599840ce93d5 Aug 18 14:52:46.433314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-DeleteServersTestJSON-247058038 Aug 18 14:52:46.433314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-DeleteServersTestJSON-247058038-project Aug 18 14:52:46.433314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:52:46.433314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:52:46.433314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 1469a960bd9241008cfb112a28bcd5d3 Aug 18 14:52:46.433314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-DeleteServersTestJSON-247058038-project Aug 18 14:52:46.433314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:52:46.433314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 5aa2e996-a18b-49a2-8456-afb00be537d4 could not be found. Aug 18 14:52:46.433314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '5aa2e996-a18b-49a2-8456-afb00be537d4'} Aug 18 14:52:46.434723 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:52:46.434723 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:52:46.434723 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:52:46.434723 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:52:46.434723 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:52:46.434723 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:52:46.434723 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:52:46.434723 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:52:46.434723 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:52:46.434723 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:52:46.434723 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5aa2e996-a18b-49a2-8456-afb00be537d4 could not be found. Aug 18 14:52:46.434723 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:52:46.434723 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:52:46.434723 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:52:46.434723 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:52:46.434723 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:52:46.434723 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:52:46.434723 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:52:46.434723 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:52:46.434723 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:52:46.437437 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:52:46.437437 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:52:46.437437 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:52:46.437437 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:52:46.437437 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:52:46.437437 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:52:46.437437 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:52:46.437437 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5aa2e996-a18b-49a2-8456-afb00be537d4 could not be found. Aug 18 14:52:46.437437 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:52:46.437437 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:52:46.437437 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:52:46.437437 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:52:46.437437 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:52:46.437437 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:52:46.437437 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:52:46.437437 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:52:46.437437 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5aa2e996-a18b-49a2-8456-afb00be537d4 could not be found. Aug 18 14:52:46.437437 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:52:46.441092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-7f1afbb0-8d89-4deb-9ef6-26c770c58742 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Returning 404 to user: Instance 5aa2e996-a18b-49a2-8456-afb00be537d4 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:52:46.442778 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-7f1afbb0-8d89-4deb-9ef6-26c770c58742 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 404 len: 111 microversion: 2.1 time: 0.120644 Aug 18 14:52:46.444015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 97/201] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:46 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:52:46.594966 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-ccbdf93f-e730-43de-b6bf-f9fe1e9800d0 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:46.597564 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-ccbdf93f-e730-43de-b6bf-f9fe1e9800d0 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:46.604556 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ccbdf93f-e730-43de-b6bf-f9fe1e9800d0 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:46.605239 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ccbdf93f-e730-43de-b6bf-f9fe1e9800d0 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:46.605516 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ccbdf93f-e730-43de-b6bf-f9fe1e9800d0 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:46.606217 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ccbdf93f-e730-43de-b6bf-f9fe1e9800d0 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:46.608718 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ccbdf93f-e730-43de-b6bf-f9fe1e9800d0 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:46.610037 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ccbdf93f-e730-43de-b6bf-f9fe1e9800d0 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:46.633754 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.wsgi [None req-ccbdf93f-e730-43de-b6bf-f9fe1e9800d0 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] HTTP exception thrown: Instance 5aa2e996-a18b-49a2-8456-afb00be537d4 could not be found. Aug 18 14:52:46.640066 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-ccbdf93f-e730-43de-b6bf-f9fe1e9800d0 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Request method failure captured: Aug 18 14:52:46.640066 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: request: GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4/os-volume_attachments HTTP/1.1 Aug 18 14:52:46.640066 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept: application/json Aug 18 14:52:46.640066 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept-Encoding: identity Aug 18 14:52:46.640066 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Connection: close Aug 18 14:52:46.640066 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Length: 0 Aug 18 14:52:46.640066 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Type: application/json Aug 18 14:52:46.640066 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Host: 10.222.0.36 Aug 18 14:52:46.640066 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Openstack-System-Scope: None Aug 18 14:52:46.640066 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: User-Agent: python-urllib3/1.26.11 Aug 18 14:52:46.640066 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Auth-Token: gAAAAABi_lHvoYzlu_82afzH-T9DMR6XiJTLrlCMg-kgAzokLIQ00LhEPQM_VBu6-JkDumPcL0dgb-mkGHtdafCYyAJplfuZ6DqkPy1kdujivQ_X6qEnxba8u9GYvZTim7x5QZ-ePhAyL0UNjtf1SuYRKGqj2TPr0c6dMb0Y4piEJ6tkvNjKLg4 Aug 18 14:52:46.640066 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Id: None Aug 18 14:52:46.640066 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Name: None Aug 18 14:52:46.640066 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Identity-Status: Confirmed Aug 18 14:52:46.640066 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Is-Admin-Project: True Aug 18 14:52:46.640066 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Id: default Aug 18 14:52:46.640066 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Name: Default Aug 18 14:52:46.640066 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Id: 2a38dab41aca4c2d9258599840ce93d5 Aug 18 14:52:46.640066 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Name: tempest-DeleteServersTestJSON-247058038 Aug 18 14:52:46.640066 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Role: reader,member Aug 18 14:52:46.640066 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Roles: reader,member Aug 18 14:52:46.641960 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a38dab41aca4c2d9258599840ce93d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a38dab41aca4c2d9258599840ce93d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2a38dab41aca4c2d9258599840ce93d5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2a38dab41aca4c2d9258599840ce93d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:52:46.641960 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant: tempest-DeleteServersTestJSON-247058038 Aug 18 14:52:46.641960 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Id: 2a38dab41aca4c2d9258599840ce93d5 Aug 18 14:52:46.641960 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Name: tempest-DeleteServersTestJSON-247058038 Aug 18 14:52:46.641960 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User: tempest-DeleteServersTestJSON-247058038-project Aug 18 14:52:46.641960 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Id: default Aug 18 14:52:46.641960 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Name: Default Aug 18 14:52:46.641960 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Id: 1469a960bd9241008cfb112a28bcd5d3 Aug 18 14:52:46.641960 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Name: tempest-DeleteServersTestJSON-247058038-project Aug 18 14:52:46.641960 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: method: > Aug 18 14:52:46.641960 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: exception: Instance 5aa2e996-a18b-49a2-8456-afb00be537d4 could not be found. Aug 18 14:52:46.641960 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: action_args: {'server_id': '5aa2e996-a18b-49a2-8456-afb00be537d4'} Aug 18 14:52:46.642755 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:52:46.642755 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:52:46.642755 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:52:46.642755 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:52:46.642755 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:52:46.642755 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:52:46.642755 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:52:46.642755 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:52:46.642755 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:52:46.642755 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:52:46.642755 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5aa2e996-a18b-49a2-8456-afb00be537d4 could not be found. Aug 18 14:52:46.642755 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:52:46.642755 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:52:46.642755 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:52:46.642755 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:52:46.642755 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:52:46.642755 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:52:46.642755 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:52:46.642755 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:52:46.642755 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:52:46.643849 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:52:46.643849 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 14:52:46.643849 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 14:52:46.643849 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 14:52:46.643849 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 14:52:46.643849 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 18 14:52:46.643849 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 18 14:52:46.643849 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:52:46.643849 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:52:46.643849 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5aa2e996-a18b-49a2-8456-afb00be537d4 could not be found. Aug 18 14:52:46.643849 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:52:46.643849 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:52:46.643849 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:52:46.643849 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:52:46.643849 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:52:46.643849 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:52:46.643849 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:52:46.643849 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:52:46.643849 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5aa2e996-a18b-49a2-8456-afb00be537d4 could not be found. Aug 18 14:52:46.643849 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:52:46.645024 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-ccbdf93f-e730-43de-b6bf-f9fe1e9800d0 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Returning 404 to user: Instance 5aa2e996-a18b-49a2-8456-afb00be537d4 could not be found. {{(pid=132267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:52:46.645024 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-ccbdf93f-e730-43de-b6bf-f9fe1e9800d0 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.051279 Aug 18 14:52:46.645024 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 105/202] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Aug 18 14:52:46 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4/os-volume_attachments => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:52:51.153458 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-affff38a-1a88-417b-b040-dc329d4e3fdc tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:51.154068 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-affff38a-1a88-417b-b040-dc329d4e3fdc tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:51.160185 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=76 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:52:51.162797 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-affff38a-1a88-417b-b040-dc329d4e3fdc tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:51.163974 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-affff38a-1a88-417b-b040-dc329d4e3fdc tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:51.164610 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-affff38a-1a88-417b-b040-dc329d4e3fdc tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:51.167080 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-affff38a-1a88-417b-b040-dc329d4e3fdc tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:51.167863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-affff38a-1a88-417b-b040-dc329d4e3fdc tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:51.168442 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-affff38a-1a88-417b-b040-dc329d4e3fdc tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:51.186267 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-affff38a-1a88-417b-b040-dc329d4e3fdc tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] HTTP exception thrown: Instance 5aa2e996-a18b-49a2-8456-afb00be537d4 could not be found. Aug 18 14:52:51.188342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-affff38a-1a88-417b-b040-dc329d4e3fdc tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Request method failure captured: Aug 18 14:52:51.188342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: DELETE /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 HTTP/1.1 Aug 18 14:52:51.188342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:52:51.188342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:52:51.188342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:52:51.188342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:52:51.188342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:52:51.188342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:52:51.188342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:52:51.188342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:52:51.188342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lHvoYzlu_82afzH-T9DMR6XiJTLrlCMg-kgAzokLIQ00LhEPQM_VBu6-JkDumPcL0dgb-mkGHtdafCYyAJplfuZ6DqkPy1kdujivQ_X6qEnxba8u9GYvZTim7x5QZ-ePhAyL0UNjtf1SuYRKGqj2TPr0c6dMb0Y4piEJ6tkvNjKLg4 Aug 18 14:52:51.188342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:52:51.188342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:52:51.188342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:52:51.188342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:52:51.188342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:52:51.188342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:52:51.188342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: 2a38dab41aca4c2d9258599840ce93d5 Aug 18 14:52:51.188342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-DeleteServersTestJSON-247058038 Aug 18 14:52:51.188342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:52:51.188342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:52:51.189586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a38dab41aca4c2d9258599840ce93d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a38dab41aca4c2d9258599840ce93d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2a38dab41aca4c2d9258599840ce93d5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2a38dab41aca4c2d9258599840ce93d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:52:51.189586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-DeleteServersTestJSON-247058038 Aug 18 14:52:51.189586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: 2a38dab41aca4c2d9258599840ce93d5 Aug 18 14:52:51.189586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-DeleteServersTestJSON-247058038 Aug 18 14:52:51.189586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-DeleteServersTestJSON-247058038-project Aug 18 14:52:51.189586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:52:51.189586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:52:51.189586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 1469a960bd9241008cfb112a28bcd5d3 Aug 18 14:52:51.189586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-DeleteServersTestJSON-247058038-project Aug 18 14:52:51.189586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:52:51.189586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 5aa2e996-a18b-49a2-8456-afb00be537d4 could not be found. Aug 18 14:52:51.189586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '5aa2e996-a18b-49a2-8456-afb00be537d4'} Aug 18 14:52:51.190247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:52:51.190247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:52:51.190247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:52:51.190247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:52:51.190247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:52:51.190247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:52:51.190247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:52:51.190247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:52:51.190247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:52:51.190247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:52:51.190247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5aa2e996-a18b-49a2-8456-afb00be537d4 could not be found. Aug 18 14:52:51.190247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:52:51.190247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:52:51.190247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:52:51.190247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:52:51.190247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:52:51.190247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:52:51.190247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:52:51.190247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:52:51.190247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:52:51.191372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:52:51.191372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 14:52:51.191372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 14:52:51.191372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 14:52:51.191372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 14:52:51.191372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:52:51.191372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:52:51.191372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:52:51.191372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:52:51.191372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5aa2e996-a18b-49a2-8456-afb00be537d4 could not be found. Aug 18 14:52:51.191372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:52:51.191372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:52:51.191372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:52:51.191372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:52:51.191372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:52:51.191372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:52:51.191372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:52:51.191372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:52:51.191372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5aa2e996-a18b-49a2-8456-afb00be537d4 could not be found. Aug 18 14:52:51.191372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:52:51.193639 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-affff38a-1a88-417b-b040-dc329d4e3fdc tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Returning 404 to user: Instance 5aa2e996-a18b-49a2-8456-afb00be537d4 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:52:51.194878 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-affff38a-1a88-417b-b040-dc329d4e3fdc tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 404 len: 111 microversion: 2.1 time: 0.045502 Aug 18 14:52:51.195853 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 98/203] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 14:52:51 2022] DELETE /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:52:51.204355 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-8e183119-88fa-48ad-a8d7-400403b36f27 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:51.205925 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-8e183119-88fa-48ad-a8d7-400403b36f27 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] [instance: 5aa2e996-a18b-49a2-8456-afb00be537d4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:51.213572 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8e183119-88fa-48ad-a8d7-400403b36f27 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:51.214312 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8e183119-88fa-48ad-a8d7-400403b36f27 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:51.214878 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8e183119-88fa-48ad-a8d7-400403b36f27 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:51.215762 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8e183119-88fa-48ad-a8d7-400403b36f27 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:51.216357 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8e183119-88fa-48ad-a8d7-400403b36f27 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:51.217035 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8e183119-88fa-48ad-a8d7-400403b36f27 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:51.235301 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.wsgi [None req-8e183119-88fa-48ad-a8d7-400403b36f27 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] HTTP exception thrown: Instance 5aa2e996-a18b-49a2-8456-afb00be537d4 could not be found. Aug 18 14:52:51.238316 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-8e183119-88fa-48ad-a8d7-400403b36f27 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Request method failure captured: Aug 18 14:52:51.238316 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: request: GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 HTTP/1.1 Aug 18 14:52:51.238316 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept: application/json Aug 18 14:52:51.238316 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept-Encoding: identity Aug 18 14:52:51.238316 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Connection: close Aug 18 14:52:51.238316 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Length: 0 Aug 18 14:52:51.238316 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Type: application/json Aug 18 14:52:51.238316 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Host: 10.222.0.36 Aug 18 14:52:51.238316 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Openstack-System-Scope: None Aug 18 14:52:51.238316 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: User-Agent: python-urllib3/1.26.11 Aug 18 14:52:51.238316 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Auth-Token: gAAAAABi_lHvoYzlu_82afzH-T9DMR6XiJTLrlCMg-kgAzokLIQ00LhEPQM_VBu6-JkDumPcL0dgb-mkGHtdafCYyAJplfuZ6DqkPy1kdujivQ_X6qEnxba8u9GYvZTim7x5QZ-ePhAyL0UNjtf1SuYRKGqj2TPr0c6dMb0Y4piEJ6tkvNjKLg4 Aug 18 14:52:51.238316 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Id: None Aug 18 14:52:51.238316 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Name: None Aug 18 14:52:51.238316 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Identity-Status: Confirmed Aug 18 14:52:51.238316 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Is-Admin-Project: True Aug 18 14:52:51.238316 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Id: default Aug 18 14:52:51.238316 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Name: Default Aug 18 14:52:51.238316 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Id: 2a38dab41aca4c2d9258599840ce93d5 Aug 18 14:52:51.238316 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Name: tempest-DeleteServersTestJSON-247058038 Aug 18 14:52:51.238316 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Role: reader,member Aug 18 14:52:51.238316 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Roles: reader,member Aug 18 14:52:51.239614 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a38dab41aca4c2d9258599840ce93d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a38dab41aca4c2d9258599840ce93d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2a38dab41aca4c2d9258599840ce93d5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2a38dab41aca4c2d9258599840ce93d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:52:51.239614 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant: tempest-DeleteServersTestJSON-247058038 Aug 18 14:52:51.239614 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Id: 2a38dab41aca4c2d9258599840ce93d5 Aug 18 14:52:51.239614 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Name: tempest-DeleteServersTestJSON-247058038 Aug 18 14:52:51.239614 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User: tempest-DeleteServersTestJSON-247058038-project Aug 18 14:52:51.239614 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Id: default Aug 18 14:52:51.239614 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Name: Default Aug 18 14:52:51.239614 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Id: 1469a960bd9241008cfb112a28bcd5d3 Aug 18 14:52:51.239614 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Name: tempest-DeleteServersTestJSON-247058038-project Aug 18 14:52:51.239614 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: method: > Aug 18 14:52:51.239614 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: exception: Instance 5aa2e996-a18b-49a2-8456-afb00be537d4 could not be found. Aug 18 14:52:51.239614 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: action_args: {'id': '5aa2e996-a18b-49a2-8456-afb00be537d4'} Aug 18 14:52:51.240305 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:52:51.240305 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:52:51.240305 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:52:51.240305 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:52:51.240305 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:52:51.240305 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:52:51.240305 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:52:51.240305 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:52:51.240305 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:52:51.240305 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:52:51.240305 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5aa2e996-a18b-49a2-8456-afb00be537d4 could not be found. Aug 18 14:52:51.240305 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:52:51.240305 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:52:51.240305 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:52:51.240305 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:52:51.240305 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:52:51.240305 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:52:51.240305 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:52:51.240305 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:52:51.240305 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:52:51.241345 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:52:51.241345 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:52:51.241345 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:52:51.241345 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:52:51.241345 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:52:51.241345 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:52:51.241345 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:52:51.241345 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5aa2e996-a18b-49a2-8456-afb00be537d4 could not be found. Aug 18 14:52:51.241345 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:52:51.241345 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:52:51.241345 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:52:51.241345 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:52:51.241345 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:52:51.241345 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:52:51.241345 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:52:51.241345 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:52:51.241345 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5aa2e996-a18b-49a2-8456-afb00be537d4 could not be found. Aug 18 14:52:51.241345 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:52:51.243549 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-8e183119-88fa-48ad-a8d7-400403b36f27 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] Returning 404 to user: Instance 5aa2e996-a18b-49a2-8456-afb00be537d4 could not be found. {{(pid=132267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:52:51.245036 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-8e183119-88fa-48ad-a8d7-400403b36f27 tempest-DeleteServersTestJSON-247058038 tempest-DeleteServersTestJSON-247058038-project] 10.222.0.36 "GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4" status: 404 len: 111 microversion: 2.1 time: 0.044635 Aug 18 14:52:51.245867 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 106/204] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:51 2022] GET /compute/v2.1/servers/5aa2e996-a18b-49a2-8456-afb00be537d4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:52:54.770655 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e05199ee-4972-4bf3-b426-2558907514d6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1794618482", "imageRef": "4083d76b-6b95-4ed8-8053-69a1270afbd4", "flavorRef": "452", "networks": [{"uuid": "7898b28e-d460-4caa-9b29-2d92b77f7041"}]}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:52:54.849582 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.network.neutron [None req-e05199ee-4972-4bf3-b426-2558907514d6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] validate_networks() for [('7898b28e-d460-4caa-9b29-2d92b77f7041', None, None, None, None, None)] {{(pid=132268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:52:56.040980 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-e05199ee-4972-4bf3-b426-2558907514d6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Flavor limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:52:56.041672 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-e05199ee-4972-4bf3-b426-2558907514d6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Image limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:52:56.041876 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-e05199ee-4972-4bf3-b426-2558907514d6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Flavor pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:52:56.042288 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-e05199ee-4972-4bf3-b426-2558907514d6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Image pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:52:56.042774 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-e05199ee-4972-4bf3-b426-2558907514d6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:52:56.062550 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e05199ee-4972-4bf3-b426-2558907514d6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:56.063042 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e05199ee-4972-4bf3-b426-2558907514d6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:56.063481 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e05199ee-4972-4bf3-b426-2558907514d6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:56.064248 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e05199ee-4972-4bf3-b426-2558907514d6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:56.064698 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e05199ee-4972-4bf3-b426-2558907514d6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:56.065401 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e05199ee-4972-4bf3-b426-2558907514d6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:56.119671 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-e05199ee-4972-4bf3-b426-2558907514d6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Getting quotas for project caf9864085c74207bd586b9493d91fe2. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:52:56.130371 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-e05199ee-4972-4bf3-b426-2558907514d6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Getting quotas for user ae0dfb7613e1432dacbfc6011efaa0ae and project caf9864085c74207bd586b9493d91fe2. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:52:56.157953 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e05199ee-4972-4bf3-b426-2558907514d6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Going to run 1 instances... {{(pid=132268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:52:56.161312 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e05199ee-4972-4bf3-b426-2558907514d6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 365debce-c9e3-4775-8950-ad99c5d8f2e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4083d76b-6b95-4ed8-8053-69a1270afbd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:52:56.223138 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e05199ee-4972-4bf3-b426-2558907514d6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.457053 Aug 18 14:52:56.224644 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 99/205] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Aug 18 14:52:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:52:56.239029 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-aea26938-d24c-4f0c-9e4f-c391a7155a64 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:56.240330 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-aea26938-d24c-4f0c-9e4f-c391a7155a64 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 365debce-c9e3-4775-8950-ad99c5d8f2e2] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:56.387520 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-aea26938-d24c-4f0c-9e4f-c391a7155a64 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:56.396871 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-aea26938-d24c-4f0c-9e4f-c391a7155a64 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2" status: 200 len: 1214 microversion: 2.1 time: 0.165393 Aug 18 14:52:56.408216 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 107/206] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:56 2022] GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2 => generated 1214 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:57.420297 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5e07ffd7-49ee-4e98-8753-a93a671f2903 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:57.420958 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-5e07ffd7-49ee-4e98-8753-a93a671f2903 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 365debce-c9e3-4775-8950-ad99c5d8f2e2] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:57.429732 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5e07ffd7-49ee-4e98-8753-a93a671f2903 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:57.430217 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5e07ffd7-49ee-4e98-8753-a93a671f2903 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:57.430829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5e07ffd7-49ee-4e98-8753-a93a671f2903 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:57.444630 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5e07ffd7-49ee-4e98-8753-a93a671f2903 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:57.445242 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5e07ffd7-49ee-4e98-8753-a93a671f2903 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:57.445682 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5e07ffd7-49ee-4e98-8753-a93a671f2903 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:57.532500 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-5e07ffd7-49ee-4e98-8753-a93a671f2903 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:57.543084 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-5e07ffd7-49ee-4e98-8753-a93a671f2903 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2" status: 200 len: 1266 microversion: 2.1 time: 0.126724 Aug 18 14:52:57.543703 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 100/207] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:57 2022] GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2 => generated 1266 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:52:58.577844 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-8cec7500-443b-4784-a915-9f76d9a34c6e tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:58.579110 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-8cec7500-443b-4784-a915-9f76d9a34c6e tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 365debce-c9e3-4775-8950-ad99c5d8f2e2] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:58.591433 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8cec7500-443b-4784-a915-9f76d9a34c6e tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:58.593767 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8cec7500-443b-4784-a915-9f76d9a34c6e tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:58.594282 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8cec7500-443b-4784-a915-9f76d9a34c6e tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:58.595383 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8cec7500-443b-4784-a915-9f76d9a34c6e tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:58.595899 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8cec7500-443b-4784-a915-9f76d9a34c6e tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:58.596362 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8cec7500-443b-4784-a915-9f76d9a34c6e tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:58.695430 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-8cec7500-443b-4784-a915-9f76d9a34c6e tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:58.707011 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-8cec7500-443b-4784-a915-9f76d9a34c6e tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2" status: 200 len: 1272 microversion: 2.1 time: 0.133211 Aug 18 14:52:58.720978 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 108/208] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:58 2022] GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2 => generated 1272 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:52:59.558031 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-963f4084-aa55-4603-872a-6929d7d7afd7 req-ec7ef5b4-19d1-4206-bdc2-8d42fe8d180e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "365debce-c9e3-4775-8950-ad99c5d8f2e2", "tag": "b99c053b-55d0-43b2-9268-cb4489191b37"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:52:59.568150 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-963f4084-aa55-4603-872a-6929d7d7afd7 req-ec7ef5b4-19d1-4206-bdc2-8d42fe8d180e service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:59.568602 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-963f4084-aa55-4603-872a-6929d7d7afd7 req-ec7ef5b4-19d1-4206-bdc2-8d42fe8d180e service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:59.569246 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-963f4084-aa55-4603-872a-6929d7d7afd7 req-ec7ef5b4-19d1-4206-bdc2-8d42fe8d180e service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:59.573906 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=84 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:52:59.584258 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-963f4084-aa55-4603-872a-6929d7d7afd7 req-ec7ef5b4-19d1-4206-bdc2-8d42fe8d180e service nova] Creating event network-changed:b99c053b-55d0-43b2-9268-cb4489191b37 for instance 365debce-c9e3-4775-8950-ad99c5d8f2e2 on hv-cinder-85220 Aug 18 14:52:59.590402 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-963f4084-aa55-4603-872a-6929d7d7afd7 req-ec7ef5b4-19d1-4206-bdc2-8d42fe8d180e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036726 Aug 18 14:52:59.591311 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 101/209] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:52:59.733051 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-208f2361-d480-4088-9d67-d6cdaccaf824 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:52:59.735001 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-208f2361-d480-4088-9d67-d6cdaccaf824 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 365debce-c9e3-4775-8950-ad99c5d8f2e2] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:52:59.743645 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-208f2361-d480-4088-9d67-d6cdaccaf824 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:59.744361 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-208f2361-d480-4088-9d67-d6cdaccaf824 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:59.744786 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-208f2361-d480-4088-9d67-d6cdaccaf824 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:59.745634 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-208f2361-d480-4088-9d67-d6cdaccaf824 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:52:59.746094 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-208f2361-d480-4088-9d67-d6cdaccaf824 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:52:59.746517 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-208f2361-d480-4088-9d67-d6cdaccaf824 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:52:59.914080 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-208f2361-d480-4088-9d67-d6cdaccaf824 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:52:59.923824 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-208f2361-d480-4088-9d67-d6cdaccaf824 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2" status: 200 len: 1314 microversion: 2.1 time: 0.196111 Aug 18 14:52:59.931937 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 109/210] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:52:59 2022] GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:00.947783 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-59b32f86-a896-41e1-aa22-448a3425d763 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:00.949026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-59b32f86-a896-41e1-aa22-448a3425d763 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 365debce-c9e3-4775-8950-ad99c5d8f2e2] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:00.957752 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-59b32f86-a896-41e1-aa22-448a3425d763 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:00.958513 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-59b32f86-a896-41e1-aa22-448a3425d763 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:00.959165 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-59b32f86-a896-41e1-aa22-448a3425d763 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:00.960252 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-59b32f86-a896-41e1-aa22-448a3425d763 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:00.960925 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-59b32f86-a896-41e1-aa22-448a3425d763 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:00.961344 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-59b32f86-a896-41e1-aa22-448a3425d763 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:01.123882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-59b32f86-a896-41e1-aa22-448a3425d763 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:01.143007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-59b32f86-a896-41e1-aa22-448a3425d763 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2" status: 200 len: 1314 microversion: 2.1 time: 0.188742 Aug 18 14:53:01.143007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 102/211] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:00 2022] GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:02.155254 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-0524b8d3-310d-4186-96d3-5a2ff5a5ae78 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:02.160198 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-0524b8d3-310d-4186-96d3-5a2ff5a5ae78 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 365debce-c9e3-4775-8950-ad99c5d8f2e2] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:02.168762 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:53:02.177445 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0524b8d3-310d-4186-96d3-5a2ff5a5ae78 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:02.178269 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0524b8d3-310d-4186-96d3-5a2ff5a5ae78 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:02.178892 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0524b8d3-310d-4186-96d3-5a2ff5a5ae78 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:02.188051 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0524b8d3-310d-4186-96d3-5a2ff5a5ae78 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:02.188926 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0524b8d3-310d-4186-96d3-5a2ff5a5ae78 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:02.189601 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0524b8d3-310d-4186-96d3-5a2ff5a5ae78 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:02.550001 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-0524b8d3-310d-4186-96d3-5a2ff5a5ae78 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:02.563765 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-0524b8d3-310d-4186-96d3-5a2ff5a5ae78 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2" status: 200 len: 1314 microversion: 2.1 time: 0.414190 Aug 18 14:53:02.565173 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 110/212] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:02 2022] GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2 => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:03.585448 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-634835cc-11d3-4496-8513-33f4245764cc tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:03.586075 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-634835cc-11d3-4496-8513-33f4245764cc tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 365debce-c9e3-4775-8950-ad99c5d8f2e2] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:03.605463 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-634835cc-11d3-4496-8513-33f4245764cc tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:03.606185 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-634835cc-11d3-4496-8513-33f4245764cc tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:03.606823 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-634835cc-11d3-4496-8513-33f4245764cc tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:03.607544 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-634835cc-11d3-4496-8513-33f4245764cc tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:03.608028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-634835cc-11d3-4496-8513-33f4245764cc tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:03.608458 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-634835cc-11d3-4496-8513-33f4245764cc tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:04.000394 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-634835cc-11d3-4496-8513-33f4245764cc tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:04.031818 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-634835cc-11d3-4496-8513-33f4245764cc tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2" status: 200 len: 1314 microversion: 2.1 time: 0.449658 Aug 18 14:53:04.036091 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 103/213] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:03 2022] GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2 => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:04.733020 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-827e7c42-c28b-4761-87c9-3167dd7b3b34 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1757482710", "imageRef": "4083d76b-6b95-4ed8-8053-69a1270afbd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:53:04.789158 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.network.neutron [None req-827e7c42-c28b-4761-87c9-3167dd7b3b34 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] validate_networks() for [('d605d7f3-d6be-4fb0-ad62-f4590af2952c', None, None, None, None, None)] {{(pid=132267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:53:05.058046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-58df1e7b-d9aa-40ce-8b57-bda1043b787f tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:05.058670 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-58df1e7b-d9aa-40ce-8b57-bda1043b787f tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 365debce-c9e3-4775-8950-ad99c5d8f2e2] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:05.066060 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-58df1e7b-d9aa-40ce-8b57-bda1043b787f tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:05.066547 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-58df1e7b-d9aa-40ce-8b57-bda1043b787f tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:05.066975 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-58df1e7b-d9aa-40ce-8b57-bda1043b787f tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:05.067698 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-58df1e7b-d9aa-40ce-8b57-bda1043b787f tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:05.068172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-58df1e7b-d9aa-40ce-8b57-bda1043b787f tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:05.068578 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-58df1e7b-d9aa-40ce-8b57-bda1043b787f tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:05.305502 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-58df1e7b-d9aa-40ce-8b57-bda1043b787f tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:05.314077 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-58df1e7b-d9aa-40ce-8b57-bda1043b787f tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2" status: 200 len: 1314 microversion: 2.1 time: 0.260895 Aug 18 14:53:05.314822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 104/214] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:05 2022] GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:05.349673 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.virt.hardware [None req-827e7c42-c28b-4761-87c9-3167dd7b3b34 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Flavor limits 0:0:0 {{(pid=132267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:53:05.350090 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.virt.hardware [None req-827e7c42-c28b-4761-87c9-3167dd7b3b34 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Image limits 0:0:0 {{(pid=132267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:53:05.350555 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.virt.hardware [None req-827e7c42-c28b-4761-87c9-3167dd7b3b34 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Flavor pref 0:0:0 {{(pid=132267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:53:05.350952 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.virt.hardware [None req-827e7c42-c28b-4761-87c9-3167dd7b3b34 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Image pref 0:0:0 {{(pid=132267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:53:05.351470 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.virt.hardware [None req-827e7c42-c28b-4761-87c9-3167dd7b3b34 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:53:05.362496 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-827e7c42-c28b-4761-87c9-3167dd7b3b34 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:05.362977 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-827e7c42-c28b-4761-87c9-3167dd7b3b34 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:05.363496 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-827e7c42-c28b-4761-87c9-3167dd7b3b34 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:05.364302 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-827e7c42-c28b-4761-87c9-3167dd7b3b34 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:05.364755 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-827e7c42-c28b-4761-87c9-3167dd7b3b34 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:05.365291 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-827e7c42-c28b-4761-87c9-3167dd7b3b34 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:05.389833 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.quota [None req-827e7c42-c28b-4761-87c9-3167dd7b3b34 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Getting quotas for project acc902aa109c4d7291c0bab62f80048e. Resources: {'ram', 'instances', 'cores'} {{(pid=132267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:53:05.394647 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.quota [None req-827e7c42-c28b-4761-87c9-3167dd7b3b34 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Getting quotas for user 26eaa7f102bd41028983458ae48ff992 and project acc902aa109c4d7291c0bab62f80048e. Resources: {'ram', 'instances', 'cores'} {{(pid=132267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:53:05.407916 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-827e7c42-c28b-4761-87c9-3167dd7b3b34 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Going to run 1 instances... {{(pid=132267) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:53:05.410396 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-827e7c42-c28b-4761-87c9-3167dd7b3b34 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4083d76b-6b95-4ed8-8053-69a1270afbd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:53:05.460821 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-827e7c42-c28b-4761-87c9-3167dd7b3b34 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.885228 Aug 18 14:53:05.461389 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 111/215] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Aug 18 14:53:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:53:05.472425 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0cca73fa-1d84-4dc2-8899-8ae20eb41776 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:05.473038 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0cca73fa-1d84-4dc2-8899-8ae20eb41776 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:05.531741 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-0cca73fa-1d84-4dc2-8899-8ae20eb41776 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:05.542192 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0cca73fa-1d84-4dc2-8899-8ae20eb41776 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1222 microversion: 2.1 time: 0.073410 Aug 18 14:53:05.542882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 105/216] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:05 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1222 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:05.611080 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-fd3d6031-8973-4ad0-b87f-40e243e768d1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1957571479", "imageRef": "4083d76b-6b95-4ed8-8053-69a1270afbd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:53:05.667851 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.network.neutron [None req-fd3d6031-8973-4ad0-b87f-40e243e768d1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] validate_networks() for [('d605d7f3-d6be-4fb0-ad62-f4590af2952c', None, None, None, None, None)] {{(pid=132267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:53:06.201553 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.virt.hardware [None req-fd3d6031-8973-4ad0-b87f-40e243e768d1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Flavor limits 0:0:0 {{(pid=132267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:53:06.202997 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.virt.hardware [None req-fd3d6031-8973-4ad0-b87f-40e243e768d1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Image limits 0:0:0 {{(pid=132267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:53:06.203709 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.virt.hardware [None req-fd3d6031-8973-4ad0-b87f-40e243e768d1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Flavor pref 0:0:0 {{(pid=132267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:53:06.204458 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.virt.hardware [None req-fd3d6031-8973-4ad0-b87f-40e243e768d1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Image pref 0:0:0 {{(pid=132267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:53:06.205096 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.virt.hardware [None req-fd3d6031-8973-4ad0-b87f-40e243e768d1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:53:06.226210 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fd3d6031-8973-4ad0-b87f-40e243e768d1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:06.229263 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fd3d6031-8973-4ad0-b87f-40e243e768d1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:06.231047 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fd3d6031-8973-4ad0-b87f-40e243e768d1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:06.237687 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fd3d6031-8973-4ad0-b87f-40e243e768d1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:06.238437 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fd3d6031-8973-4ad0-b87f-40e243e768d1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:06.238869 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fd3d6031-8973-4ad0-b87f-40e243e768d1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:06.319223 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.quota [None req-fd3d6031-8973-4ad0-b87f-40e243e768d1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Getting quotas for project acc902aa109c4d7291c0bab62f80048e. Resources: {'ram', 'instances', 'cores'} {{(pid=132267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:53:06.336626 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f2d8ee07-c272-4b2e-943e-e9c88cf638c9 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:06.337219 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f2d8ee07-c272-4b2e-943e-e9c88cf638c9 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 365debce-c9e3-4775-8950-ad99c5d8f2e2] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:06.339831 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=2 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:53:06.354835 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.quota [None req-fd3d6031-8973-4ad0-b87f-40e243e768d1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Getting quotas for user 26eaa7f102bd41028983458ae48ff992 and project acc902aa109c4d7291c0bab62f80048e. Resources: {'ram', 'instances', 'cores'} {{(pid=132267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:53:06.362833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f2d8ee07-c272-4b2e-943e-e9c88cf638c9 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:06.374226 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f2d8ee07-c272-4b2e-943e-e9c88cf638c9 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:06.377716 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f2d8ee07-c272-4b2e-943e-e9c88cf638c9 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:06.381881 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f2d8ee07-c272-4b2e-943e-e9c88cf638c9 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:06.382413 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f2d8ee07-c272-4b2e-943e-e9c88cf638c9 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:06.387415 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f2d8ee07-c272-4b2e-943e-e9c88cf638c9 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:06.440984 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-fd3d6031-8973-4ad0-b87f-40e243e768d1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Going to run 1 instances... {{(pid=132267) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:53:06.452837 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-fd3d6031-8973-4ad0-b87f-40e243e768d1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4083d76b-6b95-4ed8-8053-69a1270afbd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:53:06.571188 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-fd3d6031-8973-4ad0-b87f-40e243e768d1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.965055 Aug 18 14:53:06.581232 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 112/217] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Aug 18 14:53:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:53:06.586745 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-a4c1a75e-71d0-49ee-b7cf-149ca028c473 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:06.587370 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-a4c1a75e-71d0-49ee-b7cf-149ca028c473 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:06.767909 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-a4c1a75e-71d0-49ee-b7cf-149ca028c473 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:06.780610 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-a4c1a75e-71d0-49ee-b7cf-149ca028c473 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1222 microversion: 2.1 time: 0.197967 Aug 18 14:53:06.799267 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 113/218] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:06 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1222 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:06.878108 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f2d8ee07-c272-4b2e-943e-e9c88cf638c9 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:06.891323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f2d8ee07-c272-4b2e-943e-e9c88cf638c9 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2" status: 200 len: 1314 microversion: 2.1 time: 0.558466 Aug 18 14:53:06.904636 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 106/219] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:06 2022] GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2 => generated 1314 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:07.809243 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-cb5eea26-30cd-4b87-af1d-1808a787c1b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:07.809925 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-cb5eea26-30cd-4b87-af1d-1808a787c1b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:07.818708 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-cb5eea26-30cd-4b87-af1d-1808a787c1b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:07.819202 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-cb5eea26-30cd-4b87-af1d-1808a787c1b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:07.819648 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-cb5eea26-30cd-4b87-af1d-1808a787c1b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:07.820393 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-cb5eea26-30cd-4b87-af1d-1808a787c1b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:07.821704 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-cb5eea26-30cd-4b87-af1d-1808a787c1b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:07.822911 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-cb5eea26-30cd-4b87-af1d-1808a787c1b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:07.845054 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:53:07.915011 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-149e0903-9d25-4100-922b-01a67c0c283c tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:07.916379 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-149e0903-9d25-4100-922b-01a67c0c283c tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 365debce-c9e3-4775-8950-ad99c5d8f2e2] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:07.937464 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-149e0903-9d25-4100-922b-01a67c0c283c tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:07.938299 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-149e0903-9d25-4100-922b-01a67c0c283c tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:07.940651 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-149e0903-9d25-4100-922b-01a67c0c283c tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:07.941995 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-149e0903-9d25-4100-922b-01a67c0c283c tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:07.942680 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-149e0903-9d25-4100-922b-01a67c0c283c tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:07.943265 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-149e0903-9d25-4100-922b-01a67c0c283c tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:07.993219 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-cb5eea26-30cd-4b87-af1d-1808a787c1b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:08.004375 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-cb5eea26-30cd-4b87-af1d-1808a787c1b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1274 microversion: 2.1 time: 0.199140 Aug 18 14:53:08.005681 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 114/220] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:07 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1274 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:08.282756 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-149e0903-9d25-4100-922b-01a67c0c283c tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:08.309122 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-149e0903-9d25-4100-922b-01a67c0c283c tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2" status: 200 len: 1314 microversion: 2.1 time: 0.394962 Aug 18 14:53:08.311248 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 107/221] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:07 2022] GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2 => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:08.682943 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [req-ca7b55b8-9843-44e6-b92a-5cc411c55fe6 req-cef27eb5-6f2b-4977-b691-5331b234c898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "365debce-c9e3-4775-8950-ad99c5d8f2e2", "name": "network-vif-plugged", "status": "completed", "tag": "b99c053b-55d0-43b2-9268-cb4489191b37"}]} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:53:08.746691 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-ca7b55b8-9843-44e6-b92a-5cc411c55fe6 req-cef27eb5-6f2b-4977-b691-5331b234c898 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:08.747287 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-ca7b55b8-9843-44e6-b92a-5cc411c55fe6 req-cef27eb5-6f2b-4977-b691-5331b234c898 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:08.747752 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-ca7b55b8-9843-44e6-b92a-5cc411c55fe6 req-cef27eb5-6f2b-4977-b691-5331b234c898 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:08.799745 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.compute.server_external_events [req-ca7b55b8-9843-44e6-b92a-5cc411c55fe6 req-cef27eb5-6f2b-4977-b691-5331b234c898 service nova] Creating event network-vif-plugged:b99c053b-55d0-43b2-9268-cb4489191b37 for instance 365debce-c9e3-4775-8950-ad99c5d8f2e2 on hv-cinder-85220 Aug 18 14:53:08.807881 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [req-ca7b55b8-9843-44e6-b92a-5cc411c55fe6 req-cef27eb5-6f2b-4977-b691-5331b234c898 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129722 Aug 18 14:53:08.812052 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 115/222] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:53:09.027064 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0619530c-9a5d-407d-bdec-7f755ab31231 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:09.028065 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0619530c-9a5d-407d-bdec-7f755ab31231 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:09.048285 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0619530c-9a5d-407d-bdec-7f755ab31231 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:09.050600 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0619530c-9a5d-407d-bdec-7f755ab31231 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:09.051920 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0619530c-9a5d-407d-bdec-7f755ab31231 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:09.054663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0619530c-9a5d-407d-bdec-7f755ab31231 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:09.055321 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0619530c-9a5d-407d-bdec-7f755ab31231 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:09.056106 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0619530c-9a5d-407d-bdec-7f755ab31231 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:09.198280 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-0619530c-9a5d-407d-bdec-7f755ab31231 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:09.209968 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0619530c-9a5d-407d-bdec-7f755ab31231 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1280 microversion: 2.1 time: 0.187550 Aug 18 14:53:09.210557 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 108/223] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:09 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1280 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:09.333273 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-f896896e-288c-4b3b-957b-b8e0931e1e8b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:09.334784 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-f896896e-288c-4b3b-957b-b8e0931e1e8b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 365debce-c9e3-4775-8950-ad99c5d8f2e2] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:09.362631 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f896896e-288c-4b3b-957b-b8e0931e1e8b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:09.363386 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f896896e-288c-4b3b-957b-b8e0931e1e8b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:09.364128 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f896896e-288c-4b3b-957b-b8e0931e1e8b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:09.365180 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f896896e-288c-4b3b-957b-b8e0931e1e8b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:09.365813 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f896896e-288c-4b3b-957b-b8e0931e1e8b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:09.366526 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f896896e-288c-4b3b-957b-b8e0931e1e8b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:09.786398 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-f896896e-288c-4b3b-957b-b8e0931e1e8b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:09.800481 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-f896896e-288c-4b3b-957b-b8e0931e1e8b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2" status: 200 len: 1314 microversion: 2.1 time: 0.472927 Aug 18 14:53:09.802654 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 116/224] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:09 2022] GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2 => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:10.234000 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-36e75a3d-c21a-4caf-83ba-ad8259000dc3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:10.234773 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-36e75a3d-c21a-4caf-83ba-ad8259000dc3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:10.245955 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-36e75a3d-c21a-4caf-83ba-ad8259000dc3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:10.247322 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-36e75a3d-c21a-4caf-83ba-ad8259000dc3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:10.252952 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-36e75a3d-c21a-4caf-83ba-ad8259000dc3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:10.254112 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-36e75a3d-c21a-4caf-83ba-ad8259000dc3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:10.254793 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-36e75a3d-c21a-4caf-83ba-ad8259000dc3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:10.255422 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-36e75a3d-c21a-4caf-83ba-ad8259000dc3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:10.318055 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [req-cca6b8c8-426a-4973-8d10-a011aef96e93 req-fc9656c9-6705-43f9-ab48-d29ceff00680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15c8904a-619f-4137-9ab6-6231d51327db", "tag": "15cd7cbd-71f4-4770-84bc-48ea67b25dec"}]} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:53:10.341248 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-cca6b8c8-426a-4973-8d10-a011aef96e93 req-fc9656c9-6705-43f9-ab48-d29ceff00680 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:10.342109 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-cca6b8c8-426a-4973-8d10-a011aef96e93 req-fc9656c9-6705-43f9-ab48-d29ceff00680 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:10.342702 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-cca6b8c8-426a-4973-8d10-a011aef96e93 req-fc9656c9-6705-43f9-ab48-d29ceff00680 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:10.366401 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-36e75a3d-c21a-4caf-83ba-ad8259000dc3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:10.374036 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.compute.server_external_events [req-cca6b8c8-426a-4973-8d10-a011aef96e93 req-fc9656c9-6705-43f9-ab48-d29ceff00680 service nova] Creating event network-changed:15cd7cbd-71f4-4770-84bc-48ea67b25dec for instance 15c8904a-619f-4137-9ab6-6231d51327db on hv-cinder-85220 Aug 18 14:53:10.376584 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-36e75a3d-c21a-4caf-83ba-ad8259000dc3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1280 microversion: 2.1 time: 0.146694 Aug 18 14:53:10.380233 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 109/225] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:10 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1280 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:10.395924 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [req-cca6b8c8-426a-4973-8d10-a011aef96e93 req-fc9656c9-6705-43f9-ab48-d29ceff00680 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081188 Aug 18 14:53:10.400590 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 117/226] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:53:10.824767 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-fff91bee-eb34-4f15-860f-59577def352e tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:10.825844 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-fff91bee-eb34-4f15-860f-59577def352e tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 365debce-c9e3-4775-8950-ad99c5d8f2e2] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:10.834236 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fff91bee-eb34-4f15-860f-59577def352e tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:10.834955 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fff91bee-eb34-4f15-860f-59577def352e tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:10.836187 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fff91bee-eb34-4f15-860f-59577def352e tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:10.838099 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fff91bee-eb34-4f15-860f-59577def352e tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:10.838821 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fff91bee-eb34-4f15-860f-59577def352e tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:10.839409 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fff91bee-eb34-4f15-860f-59577def352e tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:11.014272 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-fff91bee-eb34-4f15-860f-59577def352e tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:11.024029 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-fff91bee-eb34-4f15-860f-59577def352e tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2" status: 200 len: 1314 microversion: 2.1 time: 0.203308 Aug 18 14:53:11.035976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 110/227] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:10 2022] GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:11.404100 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-80f390ac-e7b9-4d95-a88d-2deae9065f87 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:11.405775 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-80f390ac-e7b9-4d95-a88d-2deae9065f87 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:11.414394 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-80f390ac-e7b9-4d95-a88d-2deae9065f87 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:11.417027 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-80f390ac-e7b9-4d95-a88d-2deae9065f87 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:11.417691 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-80f390ac-e7b9-4d95-a88d-2deae9065f87 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:11.418985 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-80f390ac-e7b9-4d95-a88d-2deae9065f87 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:11.419657 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-80f390ac-e7b9-4d95-a88d-2deae9065f87 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:11.420320 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-80f390ac-e7b9-4d95-a88d-2deae9065f87 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:11.753449 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-80f390ac-e7b9-4d95-a88d-2deae9065f87 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:11.763547 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-80f390ac-e7b9-4d95-a88d-2deae9065f87 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1322 microversion: 2.1 time: 0.363697 Aug 18 14:53:11.765015 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 118/228] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:11 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1322 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:12.052442 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e60d969b-a084-4798-9a34-e736f41e9bc0 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:12.053179 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e60d969b-a084-4798-9a34-e736f41e9bc0 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 365debce-c9e3-4775-8950-ad99c5d8f2e2] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:12.062547 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e60d969b-a084-4798-9a34-e736f41e9bc0 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:12.063046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e60d969b-a084-4798-9a34-e736f41e9bc0 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:12.063481 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e60d969b-a084-4798-9a34-e736f41e9bc0 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:12.064317 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e60d969b-a084-4798-9a34-e736f41e9bc0 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:12.064943 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e60d969b-a084-4798-9a34-e736f41e9bc0 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:12.065589 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e60d969b-a084-4798-9a34-e736f41e9bc0 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:12.357200 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e60d969b-a084-4798-9a34-e736f41e9bc0 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:12.379651 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e60d969b-a084-4798-9a34-e736f41e9bc0 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2" status: 200 len: 1498 microversion: 2.1 time: 0.331233 Aug 18 14:53:12.380463 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 111/229] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:12 2022] GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2 => generated 1498 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:12.531141 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [req-1ee7ce5c-21da-442a-be7e-c5384f86b4d0 req-3d769e10-3189-4c6f-bcfe-666d8d55ee54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d75ecea-5192-4c86-a265-85dccf4228a4", "tag": "52d7cb31-d8e2-496b-a360-26d43f2b5c2a"}]} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:53:12.546093 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-1ee7ce5c-21da-442a-be7e-c5384f86b4d0 req-3d769e10-3189-4c6f-bcfe-666d8d55ee54 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:12.546512 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-1ee7ce5c-21da-442a-be7e-c5384f86b4d0 req-3d769e10-3189-4c6f-bcfe-666d8d55ee54 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:12.546943 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-1ee7ce5c-21da-442a-be7e-c5384f86b4d0 req-3d769e10-3189-4c6f-bcfe-666d8d55ee54 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:12.566841 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.compute.server_external_events [req-1ee7ce5c-21da-442a-be7e-c5384f86b4d0 req-3d769e10-3189-4c6f-bcfe-666d8d55ee54 service nova] Creating event network-changed:52d7cb31-d8e2-496b-a360-26d43f2b5c2a for instance 2d75ecea-5192-4c86-a265-85dccf4228a4 on hv-cinder-85220 Aug 18 14:53:12.583754 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [req-1ee7ce5c-21da-442a-be7e-c5384f86b4d0 req-3d769e10-3189-4c6f-bcfe-666d8d55ee54 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056858 Aug 18 14:53:12.584366 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 119/230] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:53:12.787093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-dad79d25-f6b6-4af4-8857-3f67513c775a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:12.787820 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-dad79d25-f6b6-4af4-8857-3f67513c775a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:12.794083 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dad79d25-f6b6-4af4-8857-3f67513c775a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:12.794657 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dad79d25-f6b6-4af4-8857-3f67513c775a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:12.794987 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dad79d25-f6b6-4af4-8857-3f67513c775a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:12.795761 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dad79d25-f6b6-4af4-8857-3f67513c775a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:12.796218 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dad79d25-f6b6-4af4-8857-3f67513c775a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:12.796643 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dad79d25-f6b6-4af4-8857-3f67513c775a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:12.982147 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-dad79d25-f6b6-4af4-8857-3f67513c775a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:12.995110 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-dad79d25-f6b6-4af4-8857-3f67513c775a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1322 microversion: 2.1 time: 0.211946 Aug 18 14:53:13.007900 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 112/231] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:12 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:13.097446 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-f12cbc07-2db8-45d0-adce-ef9ddcb0037f tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:13.098472 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-f12cbc07-2db8-45d0-adce-ef9ddcb0037f tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 365debce-c9e3-4775-8950-ad99c5d8f2e2] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:13.105923 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f12cbc07-2db8-45d0-adce-ef9ddcb0037f tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:13.106784 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f12cbc07-2db8-45d0-adce-ef9ddcb0037f tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:13.107213 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f12cbc07-2db8-45d0-adce-ef9ddcb0037f tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:13.107936 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f12cbc07-2db8-45d0-adce-ef9ddcb0037f tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:13.108849 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f12cbc07-2db8-45d0-adce-ef9ddcb0037f tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:13.109269 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f12cbc07-2db8-45d0-adce-ef9ddcb0037f tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:13.137047 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-f12cbc07-2db8-45d0-adce-ef9ddcb0037f tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 365debce-c9e3-4775-8950-ad99c5d8f2e2] Going to try to terminate instance {{(pid=132267) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:53:13.225981 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-f12cbc07-2db8-45d0-adce-ef9ddcb0037f tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "DELETE /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2" status: 204 len: 0 microversion: 2.1 time: 0.132422 Aug 18 14:53:13.226686 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 120/232] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 14:53:13 2022] DELETE /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:53:13.235835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f68aa251-7b57-4e9c-b31b-5d639a0cbad8 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:13.236619 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f68aa251-7b57-4e9c-b31b-5d639a0cbad8 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 365debce-c9e3-4775-8950-ad99c5d8f2e2] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:13.243390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f68aa251-7b57-4e9c-b31b-5d639a0cbad8 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:13.243787 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f68aa251-7b57-4e9c-b31b-5d639a0cbad8 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:13.244411 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f68aa251-7b57-4e9c-b31b-5d639a0cbad8 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:13.245277 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f68aa251-7b57-4e9c-b31b-5d639a0cbad8 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:13.245880 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f68aa251-7b57-4e9c-b31b-5d639a0cbad8 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:13.246466 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f68aa251-7b57-4e9c-b31b-5d639a0cbad8 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:13.422665 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f68aa251-7b57-4e9c-b31b-5d639a0cbad8 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:13.432703 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f68aa251-7b57-4e9c-b31b-5d639a0cbad8 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2" status: 200 len: 1504 microversion: 2.1 time: 0.200557 Aug 18 14:53:13.433202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 113/233] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:13 2022] GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2 => generated 1504 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:14.027778 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-35b4aa9f-0905-4016-8da0-90b5567a4077 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:14.030308 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-35b4aa9f-0905-4016-8da0-90b5567a4077 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:14.044236 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-35b4aa9f-0905-4016-8da0-90b5567a4077 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:14.044831 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-35b4aa9f-0905-4016-8da0-90b5567a4077 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:14.045577 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-35b4aa9f-0905-4016-8da0-90b5567a4077 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:14.046328 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-35b4aa9f-0905-4016-8da0-90b5567a4077 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:14.046791 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-35b4aa9f-0905-4016-8da0-90b5567a4077 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:14.047337 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-35b4aa9f-0905-4016-8da0-90b5567a4077 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:14.283389 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-35b4aa9f-0905-4016-8da0-90b5567a4077 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:14.294046 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-35b4aa9f-0905-4016-8da0-90b5567a4077 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1322 microversion: 2.1 time: 0.279438 Aug 18 14:53:14.296336 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 121/234] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:14 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:14.457028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-01745644-8788-4c70-a984-c11b94f4f40d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:14.457650 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-01745644-8788-4c70-a984-c11b94f4f40d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 365debce-c9e3-4775-8950-ad99c5d8f2e2] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:14.470669 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-01745644-8788-4c70-a984-c11b94f4f40d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:14.471086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-01745644-8788-4c70-a984-c11b94f4f40d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:14.471535 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-01745644-8788-4c70-a984-c11b94f4f40d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:14.472262 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-01745644-8788-4c70-a984-c11b94f4f40d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:14.473442 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-01745644-8788-4c70-a984-c11b94f4f40d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:14.474552 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-01745644-8788-4c70-a984-c11b94f4f40d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:14.761625 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-01745644-8788-4c70-a984-c11b94f4f40d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:14.778049 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-01745644-8788-4c70-a984-c11b94f4f40d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2" status: 200 len: 1504 microversion: 2.1 time: 0.325934 Aug 18 14:53:14.780296 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 114/235] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:14 2022] GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2 => generated 1504 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:15.320871 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-e6900f64-48c5-4dd9-b779-e356c8604ec2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:15.322629 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-e6900f64-48c5-4dd9-b779-e356c8604ec2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:15.332045 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e6900f64-48c5-4dd9-b779-e356c8604ec2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:15.332814 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e6900f64-48c5-4dd9-b779-e356c8604ec2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:15.333891 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e6900f64-48c5-4dd9-b779-e356c8604ec2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:15.334903 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e6900f64-48c5-4dd9-b779-e356c8604ec2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:15.335506 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e6900f64-48c5-4dd9-b779-e356c8604ec2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:15.336217 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e6900f64-48c5-4dd9-b779-e356c8604ec2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:15.757126 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-e6900f64-48c5-4dd9-b779-e356c8604ec2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:15.773199 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-e6900f64-48c5-4dd9-b779-e356c8604ec2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1322 microversion: 2.1 time: 0.456098 Aug 18 14:53:15.776018 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 122/236] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:15 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1322 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:15.800232 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-9a925800-f263-4279-8bda-8dd8232e828d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:15.801723 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-9a925800-f263-4279-8bda-8dd8232e828d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 365debce-c9e3-4775-8950-ad99c5d8f2e2] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:15.804972 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=8 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:53:15.814628 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9a925800-f263-4279-8bda-8dd8232e828d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:15.818543 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9a925800-f263-4279-8bda-8dd8232e828d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:15.819818 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9a925800-f263-4279-8bda-8dd8232e828d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:15.824939 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9a925800-f263-4279-8bda-8dd8232e828d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:15.825672 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9a925800-f263-4279-8bda-8dd8232e828d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:15.826600 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9a925800-f263-4279-8bda-8dd8232e828d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:16.535410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-9a925800-f263-4279-8bda-8dd8232e828d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:16.548303 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-9a925800-f263-4279-8bda-8dd8232e828d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2" status: 200 len: 1504 microversion: 2.1 time: 0.752461 Aug 18 14:53:16.573956 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 115/237] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:15 2022] GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2 => generated 1504 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:16.796820 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-b87c1bf4-b570-439c-a059-7eb87ebe107d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:16.798136 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-b87c1bf4-b570-439c-a059-7eb87ebe107d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:16.809023 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_cell0:SELECT=4 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:53:16.814040 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_cell0:SELECT=16 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:53:16.819449 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b87c1bf4-b570-439c-a059-7eb87ebe107d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:16.821388 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b87c1bf4-b570-439c-a059-7eb87ebe107d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:16.822702 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b87c1bf4-b570-439c-a059-7eb87ebe107d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:16.825366 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b87c1bf4-b570-439c-a059-7eb87ebe107d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:16.825969 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b87c1bf4-b570-439c-a059-7eb87ebe107d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:16.827624 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b87c1bf4-b570-439c-a059-7eb87ebe107d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:16.841000 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-097ff3ec-6047-4d27-962f-f3d30d87046f req-0e0d182a-df82-48fc-a0b0-298e339c974c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c8904a-619f-4137-9ab6-6231d51327db", "name": "network-vif-plugged", "status": "completed", "tag": "15cd7cbd-71f4-4770-84bc-48ea67b25dec"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:53:16.874047 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-097ff3ec-6047-4d27-962f-f3d30d87046f req-0e0d182a-df82-48fc-a0b0-298e339c974c service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:16.874685 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-097ff3ec-6047-4d27-962f-f3d30d87046f req-0e0d182a-df82-48fc-a0b0-298e339c974c service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:16.875336 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-097ff3ec-6047-4d27-962f-f3d30d87046f req-0e0d182a-df82-48fc-a0b0-298e339c974c service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:16.911666 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-097ff3ec-6047-4d27-962f-f3d30d87046f req-0e0d182a-df82-48fc-a0b0-298e339c974c service nova] Creating event network-vif-plugged:15cd7cbd-71f4-4770-84bc-48ea67b25dec for instance 15c8904a-619f-4137-9ab6-6231d51327db on hv-cinder-85220 Aug 18 14:53:16.926798 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-097ff3ec-6047-4d27-962f-f3d30d87046f req-0e0d182a-df82-48fc-a0b0-298e339c974c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081255 Aug 18 14:53:16.932171 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 116/238] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:53:17.175090 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-db6872dd-e11b-4c71-98fd-0bdb07bb526d req-ab52d5c6-e1d4-4313-96ac-6b3d7ec3a6ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "365debce-c9e3-4775-8950-ad99c5d8f2e2", "name": "network-vif-deleted", "tag": "b99c053b-55d0-43b2-9268-cb4489191b37"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:53:17.231752 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-db6872dd-e11b-4c71-98fd-0bdb07bb526d req-ab52d5c6-e1d4-4313-96ac-6b3d7ec3a6ea service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:17.234335 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-db6872dd-e11b-4c71-98fd-0bdb07bb526d req-ab52d5c6-e1d4-4313-96ac-6b3d7ec3a6ea service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:17.240693 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-db6872dd-e11b-4c71-98fd-0bdb07bb526d req-ab52d5c6-e1d4-4313-96ac-6b3d7ec3a6ea service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:17.300267 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-db6872dd-e11b-4c71-98fd-0bdb07bb526d req-ab52d5c6-e1d4-4313-96ac-6b3d7ec3a6ea service nova] Creating event network-vif-deleted:b99c053b-55d0-43b2-9268-cb4489191b37 for instance 365debce-c9e3-4775-8950-ad99c5d8f2e2 on hv-cinder-85220 Aug 18 14:53:17.309127 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-b87c1bf4-b570-439c-a059-7eb87ebe107d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:17.320838 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-b87c1bf4-b570-439c-a059-7eb87ebe107d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1322 microversion: 2.1 time: 0.528943 Aug 18 14:53:17.322396 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-db6872dd-e11b-4c71-98fd-0bdb07bb526d req-ab52d5c6-e1d4-4313-96ac-6b3d7ec3a6ea service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151805 Aug 18 14:53:17.328296 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 123/239] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:16 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1322 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:17.332524 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 117/240] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:53:17.569466 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-b2c28d0a-ad89-443d-82a6-a77dd61007fa tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:17.570367 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-b2c28d0a-ad89-443d-82a6-a77dd61007fa tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 365debce-c9e3-4775-8950-ad99c5d8f2e2] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:17.578085 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b2c28d0a-ad89-443d-82a6-a77dd61007fa tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:17.578575 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b2c28d0a-ad89-443d-82a6-a77dd61007fa tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:17.579005 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b2c28d0a-ad89-443d-82a6-a77dd61007fa tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:17.579764 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b2c28d0a-ad89-443d-82a6-a77dd61007fa tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:17.580459 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b2c28d0a-ad89-443d-82a6-a77dd61007fa tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:17.580892 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b2c28d0a-ad89-443d-82a6-a77dd61007fa tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:17.625333 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b2c28d0a-ad89-443d-82a6-a77dd61007fa tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:17.625822 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b2c28d0a-ad89-443d-82a6-a77dd61007fa tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:17.626252 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b2c28d0a-ad89-443d-82a6-a77dd61007fa tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:17.626714 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.objects.instance [None req-b2c28d0a-ad89-443d-82a6-a77dd61007fa tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lazy-loading 'fault' on Instance uuid 365debce-c9e3-4775-8950-ad99c5d8f2e2 {{(pid=132267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:53:17.677030 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-b2c28d0a-ad89-443d-82a6-a77dd61007fa tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:17.686974 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-b2c28d0a-ad89-443d-82a6-a77dd61007fa tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2" status: 200 len: 1304 microversion: 2.1 time: 0.121293 Aug 18 14:53:17.688037 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 124/241] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:17 2022] GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2 => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:18.356828 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f060be95-3404-4a9f-8225-ec3c07e7bb2d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:18.358587 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f060be95-3404-4a9f-8225-ec3c07e7bb2d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:18.372441 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f060be95-3404-4a9f-8225-ec3c07e7bb2d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:18.374367 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f060be95-3404-4a9f-8225-ec3c07e7bb2d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:18.374700 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f060be95-3404-4a9f-8225-ec3c07e7bb2d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:18.376152 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f060be95-3404-4a9f-8225-ec3c07e7bb2d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:18.377310 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f060be95-3404-4a9f-8225-ec3c07e7bb2d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:18.377886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f060be95-3404-4a9f-8225-ec3c07e7bb2d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:18.587363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f060be95-3404-4a9f-8225-ec3c07e7bb2d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:18.603096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f060be95-3404-4a9f-8225-ec3c07e7bb2d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1322 microversion: 2.1 time: 0.255346 Aug 18 14:53:18.604445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 118/242] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:18 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:18.722780 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-97c4f418-12fc-414b-9685-3b1faa67cef9 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:18.724549 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-97c4f418-12fc-414b-9685-3b1faa67cef9 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 365debce-c9e3-4775-8950-ad99c5d8f2e2] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:18.740140 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-97c4f418-12fc-414b-9685-3b1faa67cef9 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:18.741888 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-97c4f418-12fc-414b-9685-3b1faa67cef9 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:18.742693 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-97c4f418-12fc-414b-9685-3b1faa67cef9 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:18.744677 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-97c4f418-12fc-414b-9685-3b1faa67cef9 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:18.745218 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-97c4f418-12fc-414b-9685-3b1faa67cef9 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:18.745769 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-97c4f418-12fc-414b-9685-3b1faa67cef9 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:18.791653 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-97c4f418-12fc-414b-9685-3b1faa67cef9 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:18.793308 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-97c4f418-12fc-414b-9685-3b1faa67cef9 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:18.794050 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-97c4f418-12fc-414b-9685-3b1faa67cef9 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:18.794753 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.objects.instance [None req-97c4f418-12fc-414b-9685-3b1faa67cef9 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lazy-loading 'fault' on Instance uuid 365debce-c9e3-4775-8950-ad99c5d8f2e2 {{(pid=132267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:53:18.860296 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-97c4f418-12fc-414b-9685-3b1faa67cef9 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:18.869476 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-97c4f418-12fc-414b-9685-3b1faa67cef9 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2" status: 200 len: 1304 microversion: 2.1 time: 0.156720 Aug 18 14:53:18.872862 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 125/243] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:18 2022] GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2 => generated 1304 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:19.626677 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-379e9a9b-e657-49d4-a79f-2470868a9ece tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:19.628107 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-379e9a9b-e657-49d4-a79f-2470868a9ece tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:19.639794 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-379e9a9b-e657-49d4-a79f-2470868a9ece tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:19.640581 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-379e9a9b-e657-49d4-a79f-2470868a9ece tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:19.641248 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-379e9a9b-e657-49d4-a79f-2470868a9ece tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:19.642194 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-379e9a9b-e657-49d4-a79f-2470868a9ece tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:19.644032 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-379e9a9b-e657-49d4-a79f-2470868a9ece tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:19.644824 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-379e9a9b-e657-49d4-a79f-2470868a9ece tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:19.870687 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-379e9a9b-e657-49d4-a79f-2470868a9ece tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:19.883515 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-379e9a9b-e657-49d4-a79f-2470868a9ece tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1322 microversion: 2.1 time: 0.261438 Aug 18 14:53:19.887182 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 119/244] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:19 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:19.909866 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-80838ebe-d837-4726-9056-beff52236056 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:19.910627 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-80838ebe-d837-4726-9056-beff52236056 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 365debce-c9e3-4775-8950-ad99c5d8f2e2] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:19.917874 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-80838ebe-d837-4726-9056-beff52236056 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:19.938090 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-80838ebe-d837-4726-9056-beff52236056 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:19.941556 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-80838ebe-d837-4726-9056-beff52236056 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:19.943513 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-80838ebe-d837-4726-9056-beff52236056 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:19.946362 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-80838ebe-d837-4726-9056-beff52236056 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:19.949456 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-80838ebe-d837-4726-9056-beff52236056 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:19.986972 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.wsgi [None req-80838ebe-d837-4726-9056-beff52236056 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] HTTP exception thrown: Instance 365debce-c9e3-4775-8950-ad99c5d8f2e2 could not be found. Aug 18 14:53:19.988535 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-80838ebe-d837-4726-9056-beff52236056 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Request method failure captured: Aug 18 14:53:19.988535 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: request: GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2 HTTP/1.1 Aug 18 14:53:19.988535 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept: application/json Aug 18 14:53:19.988535 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept-Encoding: identity Aug 18 14:53:19.988535 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Connection: close Aug 18 14:53:19.988535 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Length: 0 Aug 18 14:53:19.988535 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Type: application/json Aug 18 14:53:19.988535 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Host: 10.222.0.36 Aug 18 14:53:19.988535 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Openstack-System-Scope: None Aug 18 14:53:19.988535 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: User-Agent: python-urllib3/1.26.11 Aug 18 14:53:19.988535 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Auth-Token: gAAAAABi_lJEHXWIpQoElG0p96TlEL_ir_gysZXK_3GiFSfoV10HmLMawDwnKiMu6ZOWWiaDO2iPf0ViJLVfTY2INTmr7HXCpNs1TCEIy9TjHD0VYqeTYPhLvSaBjmHsRWDBo1shpQ0T2vgrpbTDKporpiGPh3WYy-wRMwKbFEBsV-Dxg8whz1M Aug 18 14:53:19.988535 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Id: None Aug 18 14:53:19.988535 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Name: None Aug 18 14:53:19.988535 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Identity-Status: Confirmed Aug 18 14:53:19.988535 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Is-Admin-Project: True Aug 18 14:53:19.988535 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Id: default Aug 18 14:53:19.988535 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Name: Default Aug 18 14:53:19.988535 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Id: caf9864085c74207bd586b9493d91fe2 Aug 18 14:53:19.988535 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Name: tempest-VolumesActionsTest-1692432283 Aug 18 14:53:19.988535 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Role: reader,member Aug 18 14:53:19.988535 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Roles: reader,member Aug 18 14:53:19.990096 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/caf9864085c74207bd586b9493d91fe2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/caf9864085c74207bd586b9493d91fe2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_caf9864085c74207bd586b9493d91fe2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/caf9864085c74207bd586b9493d91fe2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:53:19.990096 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant: tempest-VolumesActionsTest-1692432283 Aug 18 14:53:19.990096 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Id: caf9864085c74207bd586b9493d91fe2 Aug 18 14:53:19.990096 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Name: tempest-VolumesActionsTest-1692432283 Aug 18 14:53:19.990096 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User: tempest-VolumesActionsTest-1692432283-project Aug 18 14:53:19.990096 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Id: default Aug 18 14:53:19.990096 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Name: Default Aug 18 14:53:19.990096 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Id: ae0dfb7613e1432dacbfc6011efaa0ae Aug 18 14:53:19.990096 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Name: tempest-VolumesActionsTest-1692432283-project Aug 18 14:53:19.990096 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: method: > Aug 18 14:53:19.990096 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: exception: Instance 365debce-c9e3-4775-8950-ad99c5d8f2e2 could not be found. Aug 18 14:53:19.990096 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: action_args: {'id': '365debce-c9e3-4775-8950-ad99c5d8f2e2'} Aug 18 14:53:19.990968 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:53:19.990968 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:53:19.990968 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:53:19.990968 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:53:19.990968 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:53:19.990968 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:53:19.990968 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:53:19.990968 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:53:19.990968 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:53:19.990968 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:53:19.990968 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 365debce-c9e3-4775-8950-ad99c5d8f2e2 could not be found. Aug 18 14:53:19.990968 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:53:19.990968 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:53:19.990968 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:53:19.990968 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:53:19.990968 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:53:19.990968 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:53:19.990968 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:53:19.990968 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:53:19.990968 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:53:19.992628 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:53:19.992628 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:53:19.992628 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:53:19.992628 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:53:19.992628 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:53:19.992628 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:53:19.992628 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:53:19.992628 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 365debce-c9e3-4775-8950-ad99c5d8f2e2 could not be found. Aug 18 14:53:19.992628 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:53:19.992628 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:53:19.992628 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:53:19.992628 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:53:19.992628 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:53:19.992628 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:53:19.992628 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:53:19.992628 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:53:19.992628 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 365debce-c9e3-4775-8950-ad99c5d8f2e2 could not be found. Aug 18 14:53:19.992628 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:53:19.994379 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-80838ebe-d837-4726-9056-beff52236056 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Returning 404 to user: Instance 365debce-c9e3-4775-8950-ad99c5d8f2e2 could not be found. {{(pid=132267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:53:19.994379 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-80838ebe-d837-4726-9056-beff52236056 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2" status: 404 len: 111 microversion: 2.1 time: 0.087471 Aug 18 14:53:19.994379 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 126/245] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:19 2022] GET /compute/v2.1/servers/365debce-c9e3-4775-8950-ad99c5d8f2e2 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 14:53:20.257127 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e83443a7-55be-4a02-8ef0-5fe24cd0450d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1970755986", "imageRef": "4083d76b-6b95-4ed8-8053-69a1270afbd4", "flavorRef": "452", "networks": [{"uuid": "7898b28e-d460-4caa-9b29-2d92b77f7041"}]}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:53:20.329546 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.network.neutron [None req-e83443a7-55be-4a02-8ef0-5fe24cd0450d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] validate_networks() for [('7898b28e-d460-4caa-9b29-2d92b77f7041', None, None, None, None, None)] {{(pid=132268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:53:20.910116 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-a212c18d-76f9-496b-8fca-dd05546a6025 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:20.912211 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-a212c18d-76f9-496b-8fca-dd05546a6025 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:20.914685 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-e83443a7-55be-4a02-8ef0-5fe24cd0450d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Flavor limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:53:20.916618 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-e83443a7-55be-4a02-8ef0-5fe24cd0450d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Image limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:53:20.917811 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-e83443a7-55be-4a02-8ef0-5fe24cd0450d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Flavor pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:53:20.918670 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-e83443a7-55be-4a02-8ef0-5fe24cd0450d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Image pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:53:20.919445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-e83443a7-55be-4a02-8ef0-5fe24cd0450d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:53:20.934108 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a212c18d-76f9-496b-8fca-dd05546a6025 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:20.935219 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a212c18d-76f9-496b-8fca-dd05546a6025 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:20.935855 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a212c18d-76f9-496b-8fca-dd05546a6025 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:20.936003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e83443a7-55be-4a02-8ef0-5fe24cd0450d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:20.937125 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e83443a7-55be-4a02-8ef0-5fe24cd0450d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:20.937747 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e83443a7-55be-4a02-8ef0-5fe24cd0450d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:20.938700 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e83443a7-55be-4a02-8ef0-5fe24cd0450d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:20.939005 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a212c18d-76f9-496b-8fca-dd05546a6025 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:20.939491 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a212c18d-76f9-496b-8fca-dd05546a6025 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:20.939639 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e83443a7-55be-4a02-8ef0-5fe24cd0450d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:20.939950 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a212c18d-76f9-496b-8fca-dd05546a6025 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:20.940448 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e83443a7-55be-4a02-8ef0-5fe24cd0450d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:20.966390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-e83443a7-55be-4a02-8ef0-5fe24cd0450d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Getting quotas for project caf9864085c74207bd586b9493d91fe2. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:53:20.972170 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-e83443a7-55be-4a02-8ef0-5fe24cd0450d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Getting quotas for user ae0dfb7613e1432dacbfc6011efaa0ae and project caf9864085c74207bd586b9493d91fe2. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:53:20.991538 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e83443a7-55be-4a02-8ef0-5fe24cd0450d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Going to run 1 instances... {{(pid=132268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:53:20.994769 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e83443a7-55be-4a02-8ef0-5fe24cd0450d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 8f95123c-1e30-495d-8096-c1637bffb2e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4083d76b-6b95-4ed8-8053-69a1270afbd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:53:21.069579 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e83443a7-55be-4a02-8ef0-5fe24cd0450d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.816834 Aug 18 14:53:21.070517 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 120/246] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Aug 18 14:53:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:53:21.082020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8fc9c5c7-e52e-46bb-b774-4dc1bf823cc3 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:21.082917 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-8fc9c5c7-e52e-46bb-b774-4dc1bf823cc3 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 8f95123c-1e30-495d-8096-c1637bffb2e8] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:21.187454 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-a212c18d-76f9-496b-8fca-dd05546a6025 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:21.205380 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-a212c18d-76f9-496b-8fca-dd05546a6025 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1322 microversion: 2.1 time: 0.300986 Aug 18 14:53:21.218697 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 127/247] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:20 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:21.245272 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8fc9c5c7-e52e-46bb-b774-4dc1bf823cc3 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:21.259651 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-8fc9c5c7-e52e-46bb-b774-4dc1bf823cc3 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8" status: 200 len: 1214 microversion: 2.1 time: 0.178744 Aug 18 14:53:21.263351 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-284c0c71-4479-4d21-975b-8a260c7ac75f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:21.264276 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-284c0c71-4479-4d21-975b-8a260c7ac75f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:21.272680 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-284c0c71-4479-4d21-975b-8a260c7ac75f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:21.273448 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 121/248] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:21 2022] GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8 => generated 1214 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:21.274905 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-284c0c71-4479-4d21-975b-8a260c7ac75f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:21.275532 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-284c0c71-4479-4d21-975b-8a260c7ac75f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:21.280537 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-284c0c71-4479-4d21-975b-8a260c7ac75f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:21.280991 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-284c0c71-4479-4d21-975b-8a260c7ac75f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:21.281431 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-284c0c71-4479-4d21-975b-8a260c7ac75f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:21.303597 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-656a2a8e-38ef-45f4-ac7e-c3660bd24d25 req-3b2d20a2-f67d-4cb9-a290-884e3296a769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d75ecea-5192-4c86-a265-85dccf4228a4", "name": "network-vif-plugged", "status": "completed", "tag": "52d7cb31-d8e2-496b-a360-26d43f2b5c2a"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:53:21.318742 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-284c0c71-4479-4d21-975b-8a260c7ac75f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5/ips" status: 200 len: 146 microversion: 2.1 time: 0.059843 Aug 18 14:53:21.319667 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 128/249] 10.222.0.36 () {58 vars in 1248 bytes} [Thu Aug 18 14:53:21 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5/ips => generated 146 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:53:21.356307 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:53:21.358512 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-656a2a8e-38ef-45f4-ac7e-c3660bd24d25 req-3b2d20a2-f67d-4cb9-a290-884e3296a769 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:21.359298 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-656a2a8e-38ef-45f4-ac7e-c3660bd24d25 req-3b2d20a2-f67d-4cb9-a290-884e3296a769 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:21.360603 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-656a2a8e-38ef-45f4-ac7e-c3660bd24d25 req-3b2d20a2-f67d-4cb9-a290-884e3296a769 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:21.381010 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-656a2a8e-38ef-45f4-ac7e-c3660bd24d25 req-3b2d20a2-f67d-4cb9-a290-884e3296a769 service nova] Creating event network-vif-plugged:52d7cb31-d8e2-496b-a360-26d43f2b5c2a for instance 2d75ecea-5192-4c86-a265-85dccf4228a4 on hv-cinder-85220 Aug 18 14:53:21.388585 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-656a2a8e-38ef-45f4-ac7e-c3660bd24d25 req-3b2d20a2-f67d-4cb9-a290-884e3296a769 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092734 Aug 18 14:53:21.389696 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 122/250] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:53:22.232566 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-d31d8a5b-b998-488a-8e4b-dec0656d19d7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:22.233786 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-d31d8a5b-b998-488a-8e4b-dec0656d19d7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:22.273637 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d31d8a5b-b998-488a-8e4b-dec0656d19d7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:22.274343 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d31d8a5b-b998-488a-8e4b-dec0656d19d7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:22.275048 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d31d8a5b-b998-488a-8e4b-dec0656d19d7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:22.275717 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d31d8a5b-b998-488a-8e4b-dec0656d19d7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:22.276192 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d31d8a5b-b998-488a-8e4b-dec0656d19d7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:22.276629 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d31d8a5b-b998-488a-8e4b-dec0656d19d7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:22.293228 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a65c533b-6879-421a-901d-227da470bc62 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:22.296970 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a65c533b-6879-421a-901d-227da470bc62 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 8f95123c-1e30-495d-8096-c1637bffb2e8] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:22.304539 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a65c533b-6879-421a-901d-227da470bc62 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:22.314708 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a65c533b-6879-421a-901d-227da470bc62 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:22.315504 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a65c533b-6879-421a-901d-227da470bc62 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:22.317665 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a65c533b-6879-421a-901d-227da470bc62 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:22.318481 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a65c533b-6879-421a-901d-227da470bc62 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:22.319621 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a65c533b-6879-421a-901d-227da470bc62 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:22.366371 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=100 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:53:22.625790 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a65c533b-6879-421a-901d-227da470bc62 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:22.635219 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a65c533b-6879-421a-901d-227da470bc62 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8" status: 200 len: 1218 microversion: 2.1 time: 0.354128 Aug 18 14:53:22.646319 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 123/251] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:22 2022] GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8 => generated 1218 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:22.805415 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-d31d8a5b-b998-488a-8e4b-dec0656d19d7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:22.816206 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-d31d8a5b-b998-488a-8e4b-dec0656d19d7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1322 microversion: 2.1 time: 0.593731 Aug 18 14:53:22.829707 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 129/252] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:22 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1322 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:23.659302 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8da2213f-26c6-4ef6-8193-8642b0d0492a tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:23.659954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-8da2213f-26c6-4ef6-8193-8642b0d0492a tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 8f95123c-1e30-495d-8096-c1637bffb2e8] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:23.686787 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8da2213f-26c6-4ef6-8193-8642b0d0492a tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:23.687297 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8da2213f-26c6-4ef6-8193-8642b0d0492a tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:23.687761 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8da2213f-26c6-4ef6-8193-8642b0d0492a tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:23.704058 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8da2213f-26c6-4ef6-8193-8642b0d0492a tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:23.705356 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8da2213f-26c6-4ef6-8193-8642b0d0492a tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:23.708725 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8da2213f-26c6-4ef6-8193-8642b0d0492a tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:23.836754 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-d25b41e6-8f7b-4038-bf13-da7321a1993f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:23.837418 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-d25b41e6-8f7b-4038-bf13-da7321a1993f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:23.850859 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d25b41e6-8f7b-4038-bf13-da7321a1993f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:23.855748 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d25b41e6-8f7b-4038-bf13-da7321a1993f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:23.856804 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d25b41e6-8f7b-4038-bf13-da7321a1993f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:23.857770 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d25b41e6-8f7b-4038-bf13-da7321a1993f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:23.860274 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d25b41e6-8f7b-4038-bf13-da7321a1993f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:23.861699 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d25b41e6-8f7b-4038-bf13-da7321a1993f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:23.874613 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8da2213f-26c6-4ef6-8193-8642b0d0492a tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:23.929158 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-8da2213f-26c6-4ef6-8193-8642b0d0492a tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8" status: 200 len: 1266 microversion: 2.1 time: 0.269411 Aug 18 14:53:23.930148 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 124/253] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:23 2022] GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8 => generated 1266 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:24.737919 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-d25b41e6-8f7b-4038-bf13-da7321a1993f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:24.746752 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-d25b41e6-8f7b-4038-bf13-da7321a1993f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1516 microversion: 2.1 time: 0.914026 Aug 18 14:53:24.750934 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 130/254] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:23 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1516 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:24.776181 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0b9caa94-715d-47e9-be2d-99e680d71f5f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:53:24.780078 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0b9caa94-715d-47e9-be2d-99e680d71f5f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:24.792116 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0b9caa94-715d-47e9-be2d-99e680d71f5f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:24.794071 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0b9caa94-715d-47e9-be2d-99e680d71f5f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:24.797380 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0b9caa94-715d-47e9-be2d-99e680d71f5f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:24.801616 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0b9caa94-715d-47e9-be2d-99e680d71f5f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:24.803204 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0b9caa94-715d-47e9-be2d-99e680d71f5f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:24.803931 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0b9caa94-715d-47e9-be2d-99e680d71f5f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:24.862370 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.objects.instance [None req-0b9caa94-715d-47e9-be2d-99e680d71f5f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lazy-loading 'flavor' on Instance uuid 2d75ecea-5192-4c86-a265-85dccf4228a4 {{(pid=132268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:53:24.954112 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-7d0cfe05-93fa-427d-bda4-40e413c88143 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:24.954795 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-7d0cfe05-93fa-427d-bda4-40e413c88143 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 8f95123c-1e30-495d-8096-c1637bffb2e8] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:24.985967 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7d0cfe05-93fa-427d-bda4-40e413c88143 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:24.986525 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7d0cfe05-93fa-427d-bda4-40e413c88143 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:24.986986 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7d0cfe05-93fa-427d-bda4-40e413c88143 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:24.991170 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7d0cfe05-93fa-427d-bda4-40e413c88143 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:24.991775 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7d0cfe05-93fa-427d-bda4-40e413c88143 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:24.998085 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7d0cfe05-93fa-427d-bda4-40e413c88143 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:25.020255 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:53:25.186248 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-7d0cfe05-93fa-427d-bda4-40e413c88143 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:25.197537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0b9caa94-715d-47e9-be2d-99e680d71f5f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "POST /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4/action" status: 200 len: 32 microversion: 2.1 time: 0.425439 Aug 18 14:53:25.203251 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-7d0cfe05-93fa-427d-bda4-40e413c88143 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8" status: 200 len: 1272 microversion: 2.1 time: 0.254727 Aug 18 14:53:25.207786 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 125/255] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Aug 18 14:53:24 2022] POST /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4/action => generated 32 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 14:53:25.223045 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 131/256] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:24 2022] GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8 => generated 1272 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:25.233254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b98eecf5-44b8-4cc5-b639-a27b51cffbce tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:25.234670 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b98eecf5-44b8-4cc5-b639-a27b51cffbce tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:25.241817 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-b35160df-ff93-4af8-bb16-9d1fd5e6fc6f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:25.243297 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-b35160df-ff93-4af8-bb16-9d1fd5e6fc6f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:25.257448 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b35160df-ff93-4af8-bb16-9d1fd5e6fc6f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:25.258251 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b35160df-ff93-4af8-bb16-9d1fd5e6fc6f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:25.258697 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b35160df-ff93-4af8-bb16-9d1fd5e6fc6f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:25.259457 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b35160df-ff93-4af8-bb16-9d1fd5e6fc6f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:25.259947 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b35160df-ff93-4af8-bb16-9d1fd5e6fc6f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:25.260382 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b35160df-ff93-4af8-bb16-9d1fd5e6fc6f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:25.288782 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b98eecf5-44b8-4cc5-b639-a27b51cffbce tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:25.289284 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b98eecf5-44b8-4cc5-b639-a27b51cffbce tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:25.289720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b98eecf5-44b8-4cc5-b639-a27b51cffbce tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:25.290500 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b98eecf5-44b8-4cc5-b639-a27b51cffbce tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:25.290951 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b98eecf5-44b8-4cc5-b639-a27b51cffbce tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:25.297139 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b98eecf5-44b8-4cc5-b639-a27b51cffbce tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:25.346795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b98eecf5-44b8-4cc5-b639-a27b51cffbce tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9/ips" status: 200 len: 151 microversion: 2.20 time: 0.132909 Aug 18 14:53:25.352537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 126/257] 10.222.0.36 () {60 vars in 1289 bytes} [Thu Aug 18 14:53:25 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9/ips => generated 151 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:53:25.361923 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-cfcbe756-fac7-4a64-888d-1d965c034f65 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:25.362449 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-cfcbe756-fac7-4a64-888d-1d965c034f65 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:25.378421 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cfcbe756-fac7-4a64-888d-1d965c034f65 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:25.378968 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cfcbe756-fac7-4a64-888d-1d965c034f65 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:25.379414 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cfcbe756-fac7-4a64-888d-1d965c034f65 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:25.381743 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cfcbe756-fac7-4a64-888d-1d965c034f65 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:25.383222 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cfcbe756-fac7-4a64-888d-1d965c034f65 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:25.385187 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cfcbe756-fac7-4a64-888d-1d965c034f65 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:25.443694 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-cfcbe756-fac7-4a64-888d-1d965c034f65 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6/ips" status: 200 len: 151 microversion: 2.1 time: 0.089844 Aug 18 14:53:25.444880 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 127/258] 10.222.0.36 () {58 vars in 1248 bytes} [Thu Aug 18 14:53:25 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6/ips => generated 151 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:53:25.452273 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d135b3e8-c6f4-43f7-8a24-a6766f36251f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb2c0520-9ae5-472b-8ded-130f0c438a0c"}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:53:25.455182 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d135b3e8-c6f4-43f7-8a24-a6766f36251f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:25.465795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d135b3e8-c6f4-43f7-8a24-a6766f36251f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:25.466306 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d135b3e8-c6f4-43f7-8a24-a6766f36251f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:25.466844 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d135b3e8-c6f4-43f7-8a24-a6766f36251f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:25.467539 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d135b3e8-c6f4-43f7-8a24-a6766f36251f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:25.468100 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d135b3e8-c6f4-43f7-8a24-a6766f36251f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:25.468536 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d135b3e8-c6f4-43f7-8a24-a6766f36251f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:25.881613 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-b35160df-ff93-4af8-bb16-9d1fd5e6fc6f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:25.907649 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-b35160df-ff93-4af8-bb16-9d1fd5e6fc6f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.674112 Aug 18 14:53:25.908316 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 132/259] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:25 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:26.225638 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-cf101633-ebf7-4676-b158-26493b6da451 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:26.227241 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-cf101633-ebf7-4676-b158-26493b6da451 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 8f95123c-1e30-495d-8096-c1637bffb2e8] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:26.241061 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-cf101633-ebf7-4676-b158-26493b6da451 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:26.250110 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-cf101633-ebf7-4676-b158-26493b6da451 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:26.253223 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-cf101633-ebf7-4676-b158-26493b6da451 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:26.254263 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-cf101633-ebf7-4676-b158-26493b6da451 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:26.256047 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-cf101633-ebf7-4676-b158-26493b6da451 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:26.262716 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-cf101633-ebf7-4676-b158-26493b6da451 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:26.443836 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-cf101633-ebf7-4676-b158-26493b6da451 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:26.459422 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-cf101633-ebf7-4676-b158-26493b6da451 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8" status: 200 len: 1272 microversion: 2.1 time: 0.238334 Aug 18 14:53:26.464150 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 133/260] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:26 2022] GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8 => generated 1272 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:26.874675 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d135b3e8-c6f4-43f7-8a24-a6766f36251f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "POST /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.426422 Aug 18 14:53:26.885638 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 128/261] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Aug 18 14:53:25 2022] POST /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5/os-volume_attachments => generated 194 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:53:26.931713 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-8071e58e-7ad7-486c-b0ad-06b8df821122 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:26.936653 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-8071e58e-7ad7-486c-b0ad-06b8df821122 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:26.972211 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8071e58e-7ad7-486c-b0ad-06b8df821122 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:26.974213 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8071e58e-7ad7-486c-b0ad-06b8df821122 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:26.974972 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8071e58e-7ad7-486c-b0ad-06b8df821122 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:26.977220 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8071e58e-7ad7-486c-b0ad-06b8df821122 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:26.983265 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8071e58e-7ad7-486c-b0ad-06b8df821122 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:26.986102 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8071e58e-7ad7-486c-b0ad-06b8df821122 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:27.485312 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ea4f884c-e65c-4ca6-adf5-f1d055e7ea03 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:27.486008 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ea4f884c-e65c-4ca6-adf5-f1d055e7ea03 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 8f95123c-1e30-495d-8096-c1637bffb2e8] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:27.498376 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ea4f884c-e65c-4ca6-adf5-f1d055e7ea03 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:27.498877 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ea4f884c-e65c-4ca6-adf5-f1d055e7ea03 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:27.499384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ea4f884c-e65c-4ca6-adf5-f1d055e7ea03 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:27.500137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ea4f884c-e65c-4ca6-adf5-f1d055e7ea03 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:27.500596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ea4f884c-e65c-4ca6-adf5-f1d055e7ea03 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:27.501018 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ea4f884c-e65c-4ca6-adf5-f1d055e7ea03 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:27.596373 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-8071e58e-7ad7-486c-b0ad-06b8df821122 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:27.609546 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-8071e58e-7ad7-486c-b0ad-06b8df821122 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.681962 Aug 18 14:53:27.610005 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 134/262] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:26 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:27.989937 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ea4f884c-e65c-4ca6-adf5-f1d055e7ea03 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:28.000117 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-ea4f884c-e65c-4ca6-adf5-f1d055e7ea03 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8" status: 200 len: 1314 microversion: 2.1 time: 0.519199 Aug 18 14:53:28.008164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 129/263] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:27 2022] GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8 => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:28.230347 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-569f8c26-053a-4a41-b718-a94151454e0c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31bd0bde-d58f-40fc-87ae-ff1d5cf47d92"}} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:53:28.233548 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-569f8c26-053a-4a41-b718-a94151454e0c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:28.240524 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-569f8c26-053a-4a41-b718-a94151454e0c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:28.241502 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-569f8c26-053a-4a41-b718-a94151454e0c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:28.242065 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-569f8c26-053a-4a41-b718-a94151454e0c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:28.242962 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-569f8c26-053a-4a41-b718-a94151454e0c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:28.243547 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-569f8c26-053a-4a41-b718-a94151454e0c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:28.244208 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-569f8c26-053a-4a41-b718-a94151454e0c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:28.630899 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2d4ba90e-ee07-4f2a-b2cc-b9ffc53e3996 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:28.631606 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2d4ba90e-ee07-4f2a-b2cc-b9ffc53e3996 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:28.642119 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2d4ba90e-ee07-4f2a-b2cc-b9ffc53e3996 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:28.643135 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2d4ba90e-ee07-4f2a-b2cc-b9ffc53e3996 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:28.644397 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2d4ba90e-ee07-4f2a-b2cc-b9ffc53e3996 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:28.645444 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2d4ba90e-ee07-4f2a-b2cc-b9ffc53e3996 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:28.646240 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2d4ba90e-ee07-4f2a-b2cc-b9ffc53e3996 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:28.647490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2d4ba90e-ee07-4f2a-b2cc-b9ffc53e3996 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:28.673354 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-569f8c26-053a-4a41-b718-a94151454e0c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "POST /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.447531 Aug 18 14:53:28.681633 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 135/264] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Aug 18 14:53:28 2022] POST /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6/os-volume_attachments => generated 194 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:53:28.694087 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-0c365226-7b68-4b55-bb0d-dfc7e3689eeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:53:28.697428 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-0c365226-7b68-4b55-bb0d-dfc7e3689eeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:28.718684 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0c365226-7b68-4b55-bb0d-dfc7e3689eeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:28.719408 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0c365226-7b68-4b55-bb0d-dfc7e3689eeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:28.720095 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0c365226-7b68-4b55-bb0d-dfc7e3689eeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:28.721050 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0c365226-7b68-4b55-bb0d-dfc7e3689eeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:28.721796 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0c365226-7b68-4b55-bb0d-dfc7e3689eeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:28.722432 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0c365226-7b68-4b55-bb0d-dfc7e3689eeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:28.769875 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.objects.instance [None req-0c365226-7b68-4b55-bb0d-dfc7e3689eeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lazy-loading 'flavor' on Instance uuid 3d2b6fc4-0338-4141-9ac3-7b579718fae9 {{(pid=132267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:53:29.169932 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2d4ba90e-ee07-4f2a-b2cc-b9ffc53e3996 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:29.185853 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2d4ba90e-ee07-4f2a-b2cc-b9ffc53e3996 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.558781 Aug 18 14:53:29.186535 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 130/265] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:28 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:29.190978 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-b7e20860-84c4-4e58-a80a-894d872c2c91 req-97f288e4-0dc6-41eb-b684-3edfedf685fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f95123c-1e30-495d-8096-c1637bffb2e8", "tag": "7ac94efe-b918-487d-8da6-7d03e8219270"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:53:29.216048 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-b7e20860-84c4-4e58-a80a-894d872c2c91 req-97f288e4-0dc6-41eb-b684-3edfedf685fc service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:29.217342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-b7e20860-84c4-4e58-a80a-894d872c2c91 req-97f288e4-0dc6-41eb-b684-3edfedf685fc service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:29.218085 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-b7e20860-84c4-4e58-a80a-894d872c2c91 req-97f288e4-0dc6-41eb-b684-3edfedf685fc service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:29.248629 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-0c365226-7b68-4b55-bb0d-dfc7e3689eeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "POST /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9/action" status: 202 len: 0 microversion: 2.20 time: 0.563281 Aug 18 14:53:29.249474 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 136/266] 10.222.0.36 () {62 vars in 1319 bytes} [Thu Aug 18 14:53:28 2022] POST /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9/action => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:53:29.251600 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-b7e20860-84c4-4e58-a80a-894d872c2c91 req-97f288e4-0dc6-41eb-b684-3edfedf685fc service nova] Creating event network-changed:7ac94efe-b918-487d-8da6-7d03e8219270 for instance 8f95123c-1e30-495d-8096-c1637bffb2e8 on hv-cinder-85220 Aug 18 14:53:29.260305 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-9db09518-c00a-473f-b6ce-e899cae0fdd6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:29.262331 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-b7e20860-84c4-4e58-a80a-894d872c2c91 req-97f288e4-0dc6-41eb-b684-3edfedf685fc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074640 Aug 18 14:53:29.263422 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-9db09518-c00a-473f-b6ce-e899cae0fdd6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 8f95123c-1e30-495d-8096-c1637bffb2e8] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:29.264241 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 131/267] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:53:29.272996 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-cf5d8122-a69c-458c-8dcb-d97165ad5a65 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-650203385", "imageRef": "4083d76b-6b95-4ed8-8053-69a1270afbd4", "flavorRef": "452", "networks": [{"uuid": "8c65343e-5da4-4810-a504-0bd42fa220ea"}]}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:53:29.279984 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9db09518-c00a-473f-b6ce-e899cae0fdd6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:29.280766 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9db09518-c00a-473f-b6ce-e899cae0fdd6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:29.281359 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9db09518-c00a-473f-b6ce-e899cae0fdd6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:29.282223 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9db09518-c00a-473f-b6ce-e899cae0fdd6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:29.282700 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9db09518-c00a-473f-b6ce-e899cae0fdd6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:29.288812 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9db09518-c00a-473f-b6ce-e899cae0fdd6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:29.359839 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.network.neutron [None req-cf5d8122-a69c-458c-8dcb-d97165ad5a65 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] validate_networks() for [('8c65343e-5da4-4810-a504-0bd42fa220ea', None, None, None, None, None)] {{(pid=132268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:53:29.681339 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-9db09518-c00a-473f-b6ce-e899cae0fdd6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:29.708639 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-9db09518-c00a-473f-b6ce-e899cae0fdd6 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8" status: 200 len: 1314 microversion: 2.1 time: 0.457590 Aug 18 14:53:29.709382 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 137/268] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:29 2022] GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8 => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:29.715482 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-cbec07d3-8ec8-4995-8619-34e5fc9f1139 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:29.716522 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-cbec07d3-8ec8-4995-8619-34e5fc9f1139 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:29.731869 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-cbec07d3-8ec8-4995-8619-34e5fc9f1139 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:29.732885 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-cbec07d3-8ec8-4995-8619-34e5fc9f1139 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:29.734988 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-cbec07d3-8ec8-4995-8619-34e5fc9f1139 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:29.736043 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-cbec07d3-8ec8-4995-8619-34e5fc9f1139 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:29.736842 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-cbec07d3-8ec8-4995-8619-34e5fc9f1139 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:29.737590 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-cbec07d3-8ec8-4995-8619-34e5fc9f1139 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:30.230369 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-cbec07d3-8ec8-4995-8619-34e5fc9f1139 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:30.273703 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-cbec07d3-8ec8-4995-8619-34e5fc9f1139 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:30.275926 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-cbec07d3-8ec8-4995-8619-34e5fc9f1139 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:30.277147 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-cbec07d3-8ec8-4995-8619-34e5fc9f1139 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.566396 Aug 18 14:53:30.277709 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 138/269] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:53:29 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:53:30.298731 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-ae21b501-4a36-4b5b-9358-8dd6bbce9f62 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:30.302121 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-ae21b501-4a36-4b5b-9358-8dd6bbce9f62 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:30.316172 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ae21b501-4a36-4b5b-9358-8dd6bbce9f62 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:30.316934 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ae21b501-4a36-4b5b-9358-8dd6bbce9f62 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:30.317535 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ae21b501-4a36-4b5b-9358-8dd6bbce9f62 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:30.318440 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ae21b501-4a36-4b5b-9358-8dd6bbce9f62 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:30.319085 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ae21b501-4a36-4b5b-9358-8dd6bbce9f62 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:30.319892 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ae21b501-4a36-4b5b-9358-8dd6bbce9f62 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:30.502291 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-cf5d8122-a69c-458c-8dcb-d97165ad5a65 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Flavor limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:53:30.502809 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-cf5d8122-a69c-458c-8dcb-d97165ad5a65 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Image limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:53:30.503166 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-cf5d8122-a69c-458c-8dcb-d97165ad5a65 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Flavor pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:53:30.503569 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-cf5d8122-a69c-458c-8dcb-d97165ad5a65 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Image pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:53:30.504180 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-cf5d8122-a69c-458c-8dcb-d97165ad5a65 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:53:30.536261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cf5d8122-a69c-458c-8dcb-d97165ad5a65 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:30.538093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cf5d8122-a69c-458c-8dcb-d97165ad5a65 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:30.538447 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cf5d8122-a69c-458c-8dcb-d97165ad5a65 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:30.539220 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cf5d8122-a69c-458c-8dcb-d97165ad5a65 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:30.539696 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cf5d8122-a69c-458c-8dcb-d97165ad5a65 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:30.540145 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cf5d8122-a69c-458c-8dcb-d97165ad5a65 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:30.561712 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-cf5d8122-a69c-458c-8dcb-d97165ad5a65 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Getting quotas for project 49b5f78066ec41e98faa23bacd4881cf. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:53:30.574421 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-cf5d8122-a69c-458c-8dcb-d97165ad5a65 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Getting quotas for user 2ca1c6464b6d432ab1bd3898c69a3e47 and project 49b5f78066ec41e98faa23bacd4881cf. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:53:30.593371 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-cf5d8122-a69c-458c-8dcb-d97165ad5a65 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Going to run 1 instances... {{(pid=132268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:53:30.600171 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-cf5d8122-a69c-458c-8dcb-d97165ad5a65 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: e198b9cf-f1a2-4568-831d-201df30f8dec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4083d76b-6b95-4ed8-8053-69a1270afbd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:53:30.622452 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-ae21b501-4a36-4b5b-9358-8dd6bbce9f62 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:30.630610 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-ae21b501-4a36-4b5b-9358-8dd6bbce9f62 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.346855 Aug 18 14:53:30.636766 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 139/270] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:30 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:30.672962 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-cf5d8122-a69c-458c-8dcb-d97165ad5a65 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.401088 Aug 18 14:53:30.675844 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 132/271] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Aug 18 14:53:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:53:30.685317 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-4543ca32-9a28-4240-9205-afdcfddf4c05 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:30.698386 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-4543ca32-9a28-4240-9205-afdcfddf4c05 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: e198b9cf-f1a2-4568-831d-201df30f8dec] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:30.714760 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:53:30.735049 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d045e21a-adc8-4f0a-8d76-2fdfd02a0556 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:30.735763 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d045e21a-adc8-4f0a-8d76-2fdfd02a0556 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 8f95123c-1e30-495d-8096-c1637bffb2e8] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:30.748704 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d045e21a-adc8-4f0a-8d76-2fdfd02a0556 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:30.749202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d045e21a-adc8-4f0a-8d76-2fdfd02a0556 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:30.749636 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d045e21a-adc8-4f0a-8d76-2fdfd02a0556 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:30.753938 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d045e21a-adc8-4f0a-8d76-2fdfd02a0556 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:30.755020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d045e21a-adc8-4f0a-8d76-2fdfd02a0556 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:30.761453 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d045e21a-adc8-4f0a-8d76-2fdfd02a0556 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:30.868423 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-4543ca32-9a28-4240-9205-afdcfddf4c05 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:30.877416 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-4543ca32-9a28-4240-9205-afdcfddf4c05 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec" status: 200 len: 1218 microversion: 2.1 time: 0.196445 Aug 18 14:53:30.884550 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 140/272] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:30 2022] GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec => generated 1218 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:31.077259 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d045e21a-adc8-4f0a-8d76-2fdfd02a0556 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:31.088208 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d045e21a-adc8-4f0a-8d76-2fdfd02a0556 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8" status: 200 len: 1314 microversion: 2.1 time: 0.357501 Aug 18 14:53:31.088778 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 133/273] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:30 2022] GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:31.300801 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-f8762d07-db0e-4ed7-b04a-46a7e68d2b7b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:31.301413 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-f8762d07-db0e-4ed7-b04a-46a7e68d2b7b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:31.309950 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f8762d07-db0e-4ed7-b04a-46a7e68d2b7b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:31.310436 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f8762d07-db0e-4ed7-b04a-46a7e68d2b7b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:31.311053 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f8762d07-db0e-4ed7-b04a-46a7e68d2b7b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:31.312400 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f8762d07-db0e-4ed7-b04a-46a7e68d2b7b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:31.312851 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f8762d07-db0e-4ed7-b04a-46a7e68d2b7b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:31.313455 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f8762d07-db0e-4ed7-b04a-46a7e68d2b7b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:31.615475 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-f8762d07-db0e-4ed7-b04a-46a7e68d2b7b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:31.627573 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-f8762d07-db0e-4ed7-b04a-46a7e68d2b7b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:31.632325 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-f8762d07-db0e-4ed7-b04a-46a7e68d2b7b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:31.634444 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-f8762d07-db0e-4ed7-b04a-46a7e68d2b7b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.337208 Aug 18 14:53:31.635600 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 141/274] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:53:31 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:53:31.655053 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-8725b32a-81eb-4f92-9c85-45b8eed64ded tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:31.656071 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-8725b32a-81eb-4f92-9c85-45b8eed64ded tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:31.665982 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8725b32a-81eb-4f92-9c85-45b8eed64ded tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:31.666480 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8725b32a-81eb-4f92-9c85-45b8eed64ded tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:31.666926 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8725b32a-81eb-4f92-9c85-45b8eed64ded tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:31.667646 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8725b32a-81eb-4f92-9c85-45b8eed64ded tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:31.668166 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8725b32a-81eb-4f92-9c85-45b8eed64ded tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:31.668594 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8725b32a-81eb-4f92-9c85-45b8eed64ded tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:31.826392 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f1846a3b-e12d-401c-9894-950ceed4b9f9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Action: 'create', calling method: .version_select at 0x7fb2143d20d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-198073082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOljLAjsxxWdHRHAHwixTu4/Y8FgsoaWJXv3WgIsphegiZzuCZAbUpp56FHU8EZXSoEU/U9t98yOBe9StATdsXhMPu+jw4GDw6ItlQcK6ecZE9KLSCsA4roUfoeYmMBrQg=="}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:53:31.843051 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-f1846a3b-e12d-401c-9894-950ceed4b9f9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Getting quotas for project d334ad6bd6194604a61ce4ca95149993. Resources: {'key_pairs'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:53:31.851853 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-f1846a3b-e12d-401c-9894-950ceed4b9f9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Getting quotas for user ac4d918f549c41d3ae19e80cecefa95c and project d334ad6bd6194604a61ce4ca95149993. Resources: {'key_pairs'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:53:31.865585 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-8725b32a-81eb-4f92-9c85-45b8eed64ded tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:31.876885 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f1846a3b-e12d-401c-9894-950ceed4b9f9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.309377 Aug 18 14:53:31.877415 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-8725b32a-81eb-4f92-9c85-45b8eed64ded tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.228902 Aug 18 14:53:31.877736 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 134/275] 10.222.0.36 () {60 vars in 1159 bytes} [Thu Aug 18 14:53:31 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:53:31.877994 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 142/276] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:31 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:31.907189 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8223bf59-4910-4769-bfad-8c380fd71e29 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:31.910118 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-8223bf59-4910-4769-bfad-8c380fd71e29 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: e198b9cf-f1a2-4568-831d-201df30f8dec] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:31.920987 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8223bf59-4910-4769-bfad-8c380fd71e29 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:31.922373 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8223bf59-4910-4769-bfad-8c380fd71e29 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:31.923100 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8223bf59-4910-4769-bfad-8c380fd71e29 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:31.924099 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8223bf59-4910-4769-bfad-8c380fd71e29 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:31.924703 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8223bf59-4910-4769-bfad-8c380fd71e29 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:31.930588 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8223bf59-4910-4769-bfad-8c380fd71e29 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:32.020835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8223bf59-4910-4769-bfad-8c380fd71e29 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:32.046613 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-8223bf59-4910-4769-bfad-8c380fd71e29 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec" status: 200 len: 1270 microversion: 2.1 time: 0.143241 Aug 18 14:53:32.047246 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 135/277] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:31 2022] GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec => generated 1270 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:32.113482 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-82960200-56de-417b-8b69-d7e3a6756187 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:32.114280 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-82960200-56de-417b-8b69-d7e3a6756187 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 8f95123c-1e30-495d-8096-c1637bffb2e8] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:32.123057 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-82960200-56de-417b-8b69-d7e3a6756187 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:32.123941 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-82960200-56de-417b-8b69-d7e3a6756187 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:32.124551 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-82960200-56de-417b-8b69-d7e3a6756187 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:32.126161 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-82960200-56de-417b-8b69-d7e3a6756187 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:32.126758 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-82960200-56de-417b-8b69-d7e3a6756187 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:32.127532 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-82960200-56de-417b-8b69-d7e3a6756187 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:32.464427 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-82960200-56de-417b-8b69-d7e3a6756187 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:32.496295 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-82960200-56de-417b-8b69-d7e3a6756187 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8" status: 200 len: 1314 microversion: 2.1 time: 0.387031 Aug 18 14:53:32.498138 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 143/278] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:32 2022] GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:32.660376 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-aee1c693-6616-4683-84a5-b07abe72d65e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:32.660938 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-aee1c693-6616-4683-84a5-b07abe72d65e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:32.669924 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aee1c693-6616-4683-84a5-b07abe72d65e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:32.670590 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aee1c693-6616-4683-84a5-b07abe72d65e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:32.671302 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aee1c693-6616-4683-84a5-b07abe72d65e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:32.672092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aee1c693-6616-4683-84a5-b07abe72d65e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:32.672564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aee1c693-6616-4683-84a5-b07abe72d65e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:32.673609 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aee1c693-6616-4683-84a5-b07abe72d65e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:32.862338 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-aee1c693-6616-4683-84a5-b07abe72d65e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:32.876202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-aee1c693-6616-4683-84a5-b07abe72d65e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:32.877816 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-aee1c693-6616-4683-84a5-b07abe72d65e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:32.879244 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-aee1c693-6616-4683-84a5-b07abe72d65e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.223744 Aug 18 14:53:32.880770 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 136/279] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:53:32 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:53:32.902752 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-e60936b4-7c78-4b8e-a482-0b6eefb9823d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:32.903379 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-e60936b4-7c78-4b8e-a482-0b6eefb9823d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:32.921613 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e60936b4-7c78-4b8e-a482-0b6eefb9823d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:32.922098 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e60936b4-7c78-4b8e-a482-0b6eefb9823d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:32.922543 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e60936b4-7c78-4b8e-a482-0b6eefb9823d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:32.923270 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e60936b4-7c78-4b8e-a482-0b6eefb9823d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:32.923751 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e60936b4-7c78-4b8e-a482-0b6eefb9823d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:32.924406 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e60936b4-7c78-4b8e-a482-0b6eefb9823d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:33.070241 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-4f1522c7-a751-4f0a-9fae-a93267c8fbcb tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:33.070945 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-4f1522c7-a751-4f0a-9fae-a93267c8fbcb tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: e198b9cf-f1a2-4568-831d-201df30f8dec] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:33.088827 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4f1522c7-a751-4f0a-9fae-a93267c8fbcb tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:33.091664 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4f1522c7-a751-4f0a-9fae-a93267c8fbcb tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:33.092305 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4f1522c7-a751-4f0a-9fae-a93267c8fbcb tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:33.098471 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4f1522c7-a751-4f0a-9fae-a93267c8fbcb tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:33.103260 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4f1522c7-a751-4f0a-9fae-a93267c8fbcb tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:33.104081 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4f1522c7-a751-4f0a-9fae-a93267c8fbcb tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:33.200663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-4f1522c7-a751-4f0a-9fae-a93267c8fbcb tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:33.212934 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-4f1522c7-a751-4f0a-9fae-a93267c8fbcb tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec" status: 200 len: 1276 microversion: 2.1 time: 0.145678 Aug 18 14:53:33.216496 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 137/280] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:33 2022] GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec => generated 1276 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:33.519357 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-25c68211-ed9c-4a4e-9fa3-905782ec489d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:33.523875 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-25c68211-ed9c-4a4e-9fa3-905782ec489d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 8f95123c-1e30-495d-8096-c1637bffb2e8] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:33.566504 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-25c68211-ed9c-4a4e-9fa3-905782ec489d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:33.569689 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-25c68211-ed9c-4a4e-9fa3-905782ec489d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:33.572030 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-25c68211-ed9c-4a4e-9fa3-905782ec489d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:33.573491 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-25c68211-ed9c-4a4e-9fa3-905782ec489d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:33.573986 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-25c68211-ed9c-4a4e-9fa3-905782ec489d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:33.574429 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-25c68211-ed9c-4a4e-9fa3-905782ec489d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:33.901531 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-25c68211-ed9c-4a4e-9fa3-905782ec489d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:33.914750 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-25c68211-ed9c-4a4e-9fa3-905782ec489d tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8" status: 200 len: 1314 microversion: 2.1 time: 0.399867 Aug 18 14:53:33.917654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 138/281] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:33 2022] GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8 => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:33.943250 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8d9c4a00-2f13-4c9f-b4cb-ab7ef33b8abb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:33.944663 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-e60936b4-7c78-4b8e-a482-0b6eefb9823d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:33.947917 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-8d9c4a00-2f13-4c9f-b4cb-ab7ef33b8abb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:33.956562 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-e60936b4-7c78-4b8e-a482-0b6eefb9823d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 1.058133 Aug 18 14:53:33.957381 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8d9c4a00-2f13-4c9f-b4cb-ab7ef33b8abb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:33.958031 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8d9c4a00-2f13-4c9f-b4cb-ab7ef33b8abb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:33.958634 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8d9c4a00-2f13-4c9f-b4cb-ab7ef33b8abb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:33.959567 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8d9c4a00-2f13-4c9f-b4cb-ab7ef33b8abb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:33.960388 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8d9c4a00-2f13-4c9f-b4cb-ab7ef33b8abb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:33.960894 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 144/282] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:32 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:33.961277 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8d9c4a00-2f13-4c9f-b4cb-ab7ef33b8abb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:33.991252 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:53:34.193403 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8d9c4a00-2f13-4c9f-b4cb-ab7ef33b8abb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:34.202873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8d9c4a00-2f13-4c9f-b4cb-ab7ef33b8abb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:34.204453 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8d9c4a00-2f13-4c9f-b4cb-ab7ef33b8abb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:34.205570 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-8d9c4a00-2f13-4c9f-b4cb-ab7ef33b8abb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.276664 Aug 18 14:53:34.206108 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 139/283] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:53:33 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:53:34.238711 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-fa77999e-f753-495b-b4de-f14402a11132 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:34.240070 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-fa77999e-f753-495b-b4de-f14402a11132 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: e198b9cf-f1a2-4568-831d-201df30f8dec] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:34.252513 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fa77999e-f753-495b-b4de-f14402a11132 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:34.253757 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fa77999e-f753-495b-b4de-f14402a11132 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:34.254826 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fa77999e-f753-495b-b4de-f14402a11132 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:34.255857 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fa77999e-f753-495b-b4de-f14402a11132 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:34.256501 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fa77999e-f753-495b-b4de-f14402a11132 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:34.261569 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fa77999e-f753-495b-b4de-f14402a11132 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:34.507377 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-fa77999e-f753-495b-b4de-f14402a11132 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:34.515413 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:53:34.535158 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-fa77999e-f753-495b-b4de-f14402a11132 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec" status: 200 len: 1318 microversion: 2.1 time: 0.300483 Aug 18 14:53:34.535761 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 145/284] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:34 2022] GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:34.939991 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-28123e8f-60ce-4d81-a1c1-fa6ef4f29d59 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:34.940662 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-28123e8f-60ce-4d81-a1c1-fa6ef4f29d59 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 8f95123c-1e30-495d-8096-c1637bffb2e8] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:34.951484 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-28123e8f-60ce-4d81-a1c1-fa6ef4f29d59 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:34.955419 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-28123e8f-60ce-4d81-a1c1-fa6ef4f29d59 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:34.956736 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-28123e8f-60ce-4d81-a1c1-fa6ef4f29d59 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:34.962428 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-28123e8f-60ce-4d81-a1c1-fa6ef4f29d59 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:34.963933 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-28123e8f-60ce-4d81-a1c1-fa6ef4f29d59 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:34.965726 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-28123e8f-60ce-4d81-a1c1-fa6ef4f29d59 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:34.985338 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-5e609bdf-dc1a-422f-9725-c633bfc2f119 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:34.986072 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-5e609bdf-dc1a-422f-9725-c633bfc2f119 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:35.006849 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5e609bdf-dc1a-422f-9725-c633bfc2f119 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:35.015390 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5e609bdf-dc1a-422f-9725-c633bfc2f119 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:35.015980 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5e609bdf-dc1a-422f-9725-c633bfc2f119 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:35.017672 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5e609bdf-dc1a-422f-9725-c633bfc2f119 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:35.018356 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5e609bdf-dc1a-422f-9725-c633bfc2f119 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:35.025863 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5e609bdf-dc1a-422f-9725-c633bfc2f119 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:35.431373 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-5e609bdf-dc1a-422f-9725-c633bfc2f119 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:35.443841 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-28123e8f-60ce-4d81-a1c1-fa6ef4f29d59 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:35.450808 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-5e609bdf-dc1a-422f-9725-c633bfc2f119 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.473257 Aug 18 14:53:35.453210 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 146/285] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:34 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:35.457317 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-28123e8f-60ce-4d81-a1c1-fa6ef4f29d59 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8" status: 200 len: 1314 microversion: 2.1 time: 0.521649 Aug 18 14:53:35.463946 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [req-11fd2832-ed97-4a7a-81e5-7f5f1c8a05d6 req-6fb50410-88a9-4b5d-a512-7398965b4e08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f95123c-1e30-495d-8096-c1637bffb2e8", "name": "network-vif-plugged", "status": "completed", "tag": "7ac94efe-b918-487d-8da6-7d03e8219270"}]} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:53:35.465916 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 140/286] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:34 2022] GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8 => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:35.476797 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-11fd2832-ed97-4a7a-81e5-7f5f1c8a05d6 req-6fb50410-88a9-4b5d-a512-7398965b4e08 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:35.478066 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-11fd2832-ed97-4a7a-81e5-7f5f1c8a05d6 req-6fb50410-88a9-4b5d-a512-7398965b4e08 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:35.478857 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-11fd2832-ed97-4a7a-81e5-7f5f1c8a05d6 req-6fb50410-88a9-4b5d-a512-7398965b4e08 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:35.485324 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-cb4db41f-6533-411c-9949-4614240bcd45 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:35.490692 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-cb4db41f-6533-411c-9949-4614240bcd45 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:35.500612 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.compute.server_external_events [req-11fd2832-ed97-4a7a-81e5-7f5f1c8a05d6 req-6fb50410-88a9-4b5d-a512-7398965b4e08 service nova] Creating event network-vif-plugged:7ac94efe-b918-487d-8da6-7d03e8219270 for instance 8f95123c-1e30-495d-8096-c1637bffb2e8 on hv-cinder-85220 Aug 18 14:53:35.501860 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cb4db41f-6533-411c-9949-4614240bcd45 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:35.502734 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cb4db41f-6533-411c-9949-4614240bcd45 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:35.503709 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cb4db41f-6533-411c-9949-4614240bcd45 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:35.504937 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cb4db41f-6533-411c-9949-4614240bcd45 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:35.505557 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cb4db41f-6533-411c-9949-4614240bcd45 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:35.506290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cb4db41f-6533-411c-9949-4614240bcd45 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:35.522365 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [req-11fd2832-ed97-4a7a-81e5-7f5f1c8a05d6 req-6fb50410-88a9-4b5d-a512-7398965b4e08 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067415 Aug 18 14:53:35.522966 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 147/287] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:53:35.528397 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [req-f59d28cc-f2f3-4a6c-84ca-552d3b914315 req-9060be7d-8da5-4b5c-a9ef-599a41168f28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e198b9cf-f1a2-4568-831d-201df30f8dec", "tag": "2e2321a1-97a3-4bca-aea1-3514885c55c3"}]} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:53:35.538304 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-f59d28cc-f2f3-4a6c-84ca-552d3b914315 req-9060be7d-8da5-4b5c-a9ef-599a41168f28 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:35.538794 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-f59d28cc-f2f3-4a6c-84ca-552d3b914315 req-9060be7d-8da5-4b5c-a9ef-599a41168f28 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:35.539222 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-f59d28cc-f2f3-4a6c-84ca-552d3b914315 req-9060be7d-8da5-4b5c-a9ef-599a41168f28 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:35.556720 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.compute.server_external_events [req-f59d28cc-f2f3-4a6c-84ca-552d3b914315 req-9060be7d-8da5-4b5c-a9ef-599a41168f28 service nova] Creating event network-changed:2e2321a1-97a3-4bca-aea1-3514885c55c3 for instance e198b9cf-f1a2-4568-831d-201df30f8dec on hv-cinder-85220 Aug 18 14:53:35.569488 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [req-f59d28cc-f2f3-4a6c-84ca-552d3b914315 req-9060be7d-8da5-4b5c-a9ef-599a41168f28 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044243 Aug 18 14:53:35.570672 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 148/288] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:53:35.579649 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-7e50e2cd-78bf-488c-8a5c-77bf3c7b5917 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:35.580890 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-7e50e2cd-78bf-488c-8a5c-77bf3c7b5917 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: e198b9cf-f1a2-4568-831d-201df30f8dec] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:35.591267 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7e50e2cd-78bf-488c-8a5c-77bf3c7b5917 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:35.592057 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7e50e2cd-78bf-488c-8a5c-77bf3c7b5917 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:35.592664 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7e50e2cd-78bf-488c-8a5c-77bf3c7b5917 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:35.593582 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7e50e2cd-78bf-488c-8a5c-77bf3c7b5917 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:35.594218 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7e50e2cd-78bf-488c-8a5c-77bf3c7b5917 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:35.594725 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7e50e2cd-78bf-488c-8a5c-77bf3c7b5917 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:35.928211 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-7e50e2cd-78bf-488c-8a5c-77bf3c7b5917 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:35.940851 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-cb4db41f-6533-411c-9949-4614240bcd45 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:35.947613 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-7e50e2cd-78bf-488c-8a5c-77bf3c7b5917 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec" status: 200 len: 1318 microversion: 2.1 time: 0.374603 Aug 18 14:53:35.948643 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 149/289] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:35 2022] GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:35.954922 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-273d9220-84c9-4582-a22b-e805a1230481 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:53:35.969320 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-cb4db41f-6533-411c-9949-4614240bcd45 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:35.971029 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-cb4db41f-6533-411c-9949-4614240bcd45 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:35.972338 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-cb4db41f-6533-411c-9949-4614240bcd45 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.496857 Aug 18 14:53:35.974104 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-273d9220-84c9-4582-a22b-e805a1230481 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:35.974611 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-273d9220-84c9-4582-a22b-e805a1230481 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:35.975056 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-273d9220-84c9-4582-a22b-e805a1230481 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:35.985228 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 141/290] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:53:35 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:53:36.061256 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-273d9220-84c9-4582-a22b-e805a1230481 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Going to try to stop instance {{(pid=132267) force_stop /opt/stack/nova/nova/compute/api.py:2752}} Aug 18 14:53:36.136474 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-273d9220-84c9-4582-a22b-e805a1230481 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "POST /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5/action" status: 202 len: 0 microversion: 2.1 time: 0.186150 Aug 18 14:53:36.142404 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 150/291] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Aug 18 14:53:35 2022] POST /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:53:36.145855 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-879a3224-05ae-4b43-95d8-9e1bcd7f8020 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:36.146476 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-879a3224-05ae-4b43-95d8-9e1bcd7f8020 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:36.163501 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-879a3224-05ae-4b43-95d8-9e1bcd7f8020 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:36.164579 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-879a3224-05ae-4b43-95d8-9e1bcd7f8020 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:36.165239 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-879a3224-05ae-4b43-95d8-9e1bcd7f8020 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:36.166038 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-879a3224-05ae-4b43-95d8-9e1bcd7f8020 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:36.168438 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-879a3224-05ae-4b43-95d8-9e1bcd7f8020 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:36.169119 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-879a3224-05ae-4b43-95d8-9e1bcd7f8020 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:36.369566 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-879a3224-05ae-4b43-95d8-9e1bcd7f8020 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:36.378311 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-879a3224-05ae-4b43-95d8-9e1bcd7f8020 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1723 microversion: 2.1 time: 0.236280 Aug 18 14:53:36.378895 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 142/292] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:36 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:36.473768 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-f4006ec4-e97d-4261-8d57-f26ddc3561b9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:36.474476 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-f4006ec4-e97d-4261-8d57-f26ddc3561b9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:36.481923 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f4006ec4-e97d-4261-8d57-f26ddc3561b9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:36.482500 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f4006ec4-e97d-4261-8d57-f26ddc3561b9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:36.482941 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f4006ec4-e97d-4261-8d57-f26ddc3561b9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:36.483709 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f4006ec4-e97d-4261-8d57-f26ddc3561b9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:36.484148 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f4006ec4-e97d-4261-8d57-f26ddc3561b9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:36.484568 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f4006ec4-e97d-4261-8d57-f26ddc3561b9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:36.487998 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-317e4c47-1074-4494-83ab-706a1eda0f79 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:36.488743 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-317e4c47-1074-4494-83ab-706a1eda0f79 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 8f95123c-1e30-495d-8096-c1637bffb2e8] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:36.495331 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-317e4c47-1074-4494-83ab-706a1eda0f79 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:36.495860 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-317e4c47-1074-4494-83ab-706a1eda0f79 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:36.496304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-317e4c47-1074-4494-83ab-706a1eda0f79 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:36.497016 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-317e4c47-1074-4494-83ab-706a1eda0f79 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:36.497472 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-317e4c47-1074-4494-83ab-706a1eda0f79 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:36.497893 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-317e4c47-1074-4494-83ab-706a1eda0f79 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:36.703281 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-f4006ec4-e97d-4261-8d57-f26ddc3561b9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:36.711232 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-317e4c47-1074-4494-83ab-706a1eda0f79 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:36.713670 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-f4006ec4-e97d-4261-8d57-f26ddc3561b9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.244032 Aug 18 14:53:36.714248 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 151/293] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:36 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:36.720022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-317e4c47-1074-4494-83ab-706a1eda0f79 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8" status: 200 len: 1314 microversion: 2.1 time: 0.236207 Aug 18 14:53:36.720607 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 143/294] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:36 2022] GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:36.968952 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-aaa1f1bb-a82a-4767-ae8f-cba11bd5e3c7 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:36.969565 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-aaa1f1bb-a82a-4767-ae8f-cba11bd5e3c7 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: e198b9cf-f1a2-4568-831d-201df30f8dec] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:36.975700 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-aaa1f1bb-a82a-4767-ae8f-cba11bd5e3c7 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:36.976215 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-aaa1f1bb-a82a-4767-ae8f-cba11bd5e3c7 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:36.976646 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-aaa1f1bb-a82a-4767-ae8f-cba11bd5e3c7 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:36.977342 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-aaa1f1bb-a82a-4767-ae8f-cba11bd5e3c7 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:36.978311 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-aaa1f1bb-a82a-4767-ae8f-cba11bd5e3c7 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:36.978729 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-aaa1f1bb-a82a-4767-ae8f-cba11bd5e3c7 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:37.001394 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-6b31ece5-d31f-4496-b58d-47ba7ca89baf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:37.002002 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-6b31ece5-d31f-4496-b58d-47ba7ca89baf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:37.008249 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6b31ece5-d31f-4496-b58d-47ba7ca89baf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:37.008750 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6b31ece5-d31f-4496-b58d-47ba7ca89baf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:37.009326 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6b31ece5-d31f-4496-b58d-47ba7ca89baf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:37.010022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6b31ece5-d31f-4496-b58d-47ba7ca89baf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:37.010477 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6b31ece5-d31f-4496-b58d-47ba7ca89baf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:37.010893 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6b31ece5-d31f-4496-b58d-47ba7ca89baf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:37.186249 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-aaa1f1bb-a82a-4767-ae8f-cba11bd5e3c7 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:37.197263 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-aaa1f1bb-a82a-4767-ae8f-cba11bd5e3c7 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec" status: 200 len: 1318 microversion: 2.1 time: 0.232059 Aug 18 14:53:37.197823 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 152/295] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:36 2022] GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:37.201164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6b31ece5-d31f-4496-b58d-47ba7ca89baf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:37.209884 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6b31ece5-d31f-4496-b58d-47ba7ca89baf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:37.211499 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6b31ece5-d31f-4496-b58d-47ba7ca89baf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:37.214226 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-6b31ece5-d31f-4496-b58d-47ba7ca89baf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.216213 Aug 18 14:53:37.215204 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 144/296] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:53:36 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:53:37.400109 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-3743cee9-de55-4970-b979-28177ffa75de tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:37.400715 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-3743cee9-de55-4970-b979-28177ffa75de tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:37.406829 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-3743cee9-de55-4970-b979-28177ffa75de tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:37.407324 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-3743cee9-de55-4970-b979-28177ffa75de tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:37.407780 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-3743cee9-de55-4970-b979-28177ffa75de tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:37.408654 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-3743cee9-de55-4970-b979-28177ffa75de tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:37.408925 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-3743cee9-de55-4970-b979-28177ffa75de tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:37.409316 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-3743cee9-de55-4970-b979-28177ffa75de tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:37.552413 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-3743cee9-de55-4970-b979-28177ffa75de tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:37.560935 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-3743cee9-de55-4970-b979-28177ffa75de tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1723 microversion: 2.1 time: 0.165229 Aug 18 14:53:37.561510 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 153/297] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:37 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:37.735102 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d88e4e25-ead9-4ccb-a046-d363415a0fac tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:37.735834 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d88e4e25-ead9-4ccb-a046-d363415a0fac tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:37.741169 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-4e112bfc-810a-4267-865f-33057e73d3ef tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:37.741787 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-4e112bfc-810a-4267-865f-33057e73d3ef tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 8f95123c-1e30-495d-8096-c1637bffb2e8] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:37.742098 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d88e4e25-ead9-4ccb-a046-d363415a0fac tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:37.742653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d88e4e25-ead9-4ccb-a046-d363415a0fac tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:37.743149 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d88e4e25-ead9-4ccb-a046-d363415a0fac tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:37.743934 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d88e4e25-ead9-4ccb-a046-d363415a0fac tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:37.744485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d88e4e25-ead9-4ccb-a046-d363415a0fac tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:37.744968 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d88e4e25-ead9-4ccb-a046-d363415a0fac tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:37.747695 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4e112bfc-810a-4267-865f-33057e73d3ef tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:37.748255 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4e112bfc-810a-4267-865f-33057e73d3ef tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:37.748685 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4e112bfc-810a-4267-865f-33057e73d3ef tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:37.749413 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4e112bfc-810a-4267-865f-33057e73d3ef tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:37.749865 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4e112bfc-810a-4267-865f-33057e73d3ef tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:37.750286 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4e112bfc-810a-4267-865f-33057e73d3ef tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:37.951467 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d88e4e25-ead9-4ccb-a046-d363415a0fac tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:37.954629 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-4e112bfc-810a-4267-865f-33057e73d3ef tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:37.959536 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d88e4e25-ead9-4ccb-a046-d363415a0fac tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.228618 Aug 18 14:53:37.960141 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 145/298] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:37 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:37.962817 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-4e112bfc-810a-4267-865f-33057e73d3ef tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8" status: 200 len: 1314 microversion: 2.1 time: 0.225383 Aug 18 14:53:37.963559 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 154/299] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:37 2022] GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:38.218560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b97b5ea5-83c8-42e0-abd5-bd214754b7b3 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:38.219171 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b97b5ea5-83c8-42e0-abd5-bd214754b7b3 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: e198b9cf-f1a2-4568-831d-201df30f8dec] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:38.225763 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b97b5ea5-83c8-42e0-abd5-bd214754b7b3 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:38.226253 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b97b5ea5-83c8-42e0-abd5-bd214754b7b3 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:38.226693 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b97b5ea5-83c8-42e0-abd5-bd214754b7b3 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:38.227402 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b97b5ea5-83c8-42e0-abd5-bd214754b7b3 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:38.227932 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b97b5ea5-83c8-42e0-abd5-bd214754b7b3 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:38.228373 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b97b5ea5-83c8-42e0-abd5-bd214754b7b3 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:38.237956 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-fa3844f0-114e-4818-9617-b3b68aeb00cf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:38.238602 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-fa3844f0-114e-4818-9617-b3b68aeb00cf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:38.245789 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fa3844f0-114e-4818-9617-b3b68aeb00cf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:38.246294 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fa3844f0-114e-4818-9617-b3b68aeb00cf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:38.246726 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fa3844f0-114e-4818-9617-b3b68aeb00cf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:38.247418 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fa3844f0-114e-4818-9617-b3b68aeb00cf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:38.247903 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fa3844f0-114e-4818-9617-b3b68aeb00cf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:38.248321 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fa3844f0-114e-4818-9617-b3b68aeb00cf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:38.453578 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b97b5ea5-83c8-42e0-abd5-bd214754b7b3 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:38.461762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b97b5ea5-83c8-42e0-abd5-bd214754b7b3 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec" status: 200 len: 1318 microversion: 2.1 time: 0.247230 Aug 18 14:53:38.462364 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 146/300] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:38 2022] GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:38.467363 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-fa3844f0-114e-4818-9617-b3b68aeb00cf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:38.476106 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-fa3844f0-114e-4818-9617-b3b68aeb00cf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:38.478128 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-fa3844f0-114e-4818-9617-b3b68aeb00cf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:38.479297 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-fa3844f0-114e-4818-9617-b3b68aeb00cf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.245249 Aug 18 14:53:38.479900 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 155/301] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:53:38 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:53:38.592806 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-07e3a231-e66f-4212-b50a-4df1c1b2e481 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:38.592806 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-07e3a231-e66f-4212-b50a-4df1c1b2e481 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:38.597446 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-07e3a231-e66f-4212-b50a-4df1c1b2e481 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:38.597879 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-07e3a231-e66f-4212-b50a-4df1c1b2e481 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:38.598318 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-07e3a231-e66f-4212-b50a-4df1c1b2e481 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:38.599082 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-07e3a231-e66f-4212-b50a-4df1c1b2e481 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:38.599631 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-07e3a231-e66f-4212-b50a-4df1c1b2e481 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:38.600095 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-07e3a231-e66f-4212-b50a-4df1c1b2e481 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:38.798361 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-07e3a231-e66f-4212-b50a-4df1c1b2e481 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:38.808124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-07e3a231-e66f-4212-b50a-4df1c1b2e481 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1723 microversion: 2.1 time: 0.223584 Aug 18 14:53:38.808703 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 147/302] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:38 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:38.985549 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-b26dabee-65b1-4488-9c9a-882a468e88aa tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:38.986168 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-b26dabee-65b1-4488-9c9a-882a468e88aa tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:38.989597 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b9a66ad0-6682-45f4-b628-6c4e45015253 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:38.990224 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b9a66ad0-6682-45f4-b628-6c4e45015253 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 8f95123c-1e30-495d-8096-c1637bffb2e8] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:38.993755 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b26dabee-65b1-4488-9c9a-882a468e88aa tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:38.994656 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b26dabee-65b1-4488-9c9a-882a468e88aa tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:38.994656 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b26dabee-65b1-4488-9c9a-882a468e88aa tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:38.995477 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b26dabee-65b1-4488-9c9a-882a468e88aa tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:38.995979 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b26dabee-65b1-4488-9c9a-882a468e88aa tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:38.996405 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b26dabee-65b1-4488-9c9a-882a468e88aa tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:39.000954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b9a66ad0-6682-45f4-b628-6c4e45015253 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:39.000954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b9a66ad0-6682-45f4-b628-6c4e45015253 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:39.000954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b9a66ad0-6682-45f4-b628-6c4e45015253 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:39.000954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b9a66ad0-6682-45f4-b628-6c4e45015253 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:39.001339 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b9a66ad0-6682-45f4-b628-6c4e45015253 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:39.001339 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b9a66ad0-6682-45f4-b628-6c4e45015253 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:39.217755 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-b26dabee-65b1-4488-9c9a-882a468e88aa tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:39.220900 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b9a66ad0-6682-45f4-b628-6c4e45015253 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:39.227071 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-b26dabee-65b1-4488-9c9a-882a468e88aa tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.250564 Aug 18 14:53:39.228114 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 156/303] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:38 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:39.229604 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b9a66ad0-6682-45f4-b628-6c4e45015253 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8" status: 200 len: 1314 microversion: 2.1 time: 0.249062 Aug 18 14:53:39.230188 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 148/304] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:38 2022] GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:39.485603 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-205de3ab-87f7-400d-8a76-081d6a08029a tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:39.486278 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-205de3ab-87f7-400d-8a76-081d6a08029a tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: e198b9cf-f1a2-4568-831d-201df30f8dec] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:39.494333 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-205de3ab-87f7-400d-8a76-081d6a08029a tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:39.494909 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-205de3ab-87f7-400d-8a76-081d6a08029a tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:39.495409 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-205de3ab-87f7-400d-8a76-081d6a08029a tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:39.496202 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-205de3ab-87f7-400d-8a76-081d6a08029a tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:39.496914 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-205de3ab-87f7-400d-8a76-081d6a08029a tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:39.497334 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-205de3ab-87f7-400d-8a76-081d6a08029a tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:39.503337 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ccca9e50-fc7a-494b-a786-8ab097f3ca63 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:39.503986 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ccca9e50-fc7a-494b-a786-8ab097f3ca63 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:39.510891 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ccca9e50-fc7a-494b-a786-8ab097f3ca63 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:39.511371 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ccca9e50-fc7a-494b-a786-8ab097f3ca63 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:39.511831 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ccca9e50-fc7a-494b-a786-8ab097f3ca63 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:39.512520 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ccca9e50-fc7a-494b-a786-8ab097f3ca63 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:39.513140 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ccca9e50-fc7a-494b-a786-8ab097f3ca63 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:39.513559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ccca9e50-fc7a-494b-a786-8ab097f3ca63 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:39.710130 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-205de3ab-87f7-400d-8a76-081d6a08029a tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:39.718047 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ccca9e50-fc7a-494b-a786-8ab097f3ca63 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:39.719964 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-205de3ab-87f7-400d-8a76-081d6a08029a tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec" status: 200 len: 1318 microversion: 2.1 time: 0.239945 Aug 18 14:53:39.727205 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 157/305] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:39 2022] GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:39.734122 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ccca9e50-fc7a-494b-a786-8ab097f3ca63 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:39.736145 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ccca9e50-fc7a-494b-a786-8ab097f3ca63 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:39.737355 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-ccca9e50-fc7a-494b-a786-8ab097f3ca63 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.238317 Aug 18 14:53:39.739976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 149/306] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:53:39 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:53:39.830078 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-f7153c94-83dc-43e2-9109-950fab931b77 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:39.830772 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-f7153c94-83dc-43e2-9109-950fab931b77 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:39.840576 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f7153c94-83dc-43e2-9109-950fab931b77 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:39.841814 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f7153c94-83dc-43e2-9109-950fab931b77 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:39.842758 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f7153c94-83dc-43e2-9109-950fab931b77 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:39.844001 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f7153c94-83dc-43e2-9109-950fab931b77 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:39.848314 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f7153c94-83dc-43e2-9109-950fab931b77 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:39.848830 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f7153c94-83dc-43e2-9109-950fab931b77 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:39.989877 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-f7153c94-83dc-43e2-9109-950fab931b77 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:39.998323 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-f7153c94-83dc-43e2-9109-950fab931b77 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1723 microversion: 2.1 time: 0.172468 Aug 18 14:53:39.998899 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 158/307] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:39 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:40.248683 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-bb4746ac-71a1-427b-a2c6-bb25668221f8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:40.249212 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-bb4746ac-71a1-427b-a2c6-bb25668221f8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:40.252069 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-897f8684-8754-458b-94f5-14d6ea25238b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:40.252695 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-897f8684-8754-458b-94f5-14d6ea25238b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 8f95123c-1e30-495d-8096-c1637bffb2e8] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:40.257346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bb4746ac-71a1-427b-a2c6-bb25668221f8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:40.258416 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bb4746ac-71a1-427b-a2c6-bb25668221f8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:40.259616 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bb4746ac-71a1-427b-a2c6-bb25668221f8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:40.260797 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bb4746ac-71a1-427b-a2c6-bb25668221f8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:40.261281 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bb4746ac-71a1-427b-a2c6-bb25668221f8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:40.261706 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bb4746ac-71a1-427b-a2c6-bb25668221f8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:40.262399 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-897f8684-8754-458b-94f5-14d6ea25238b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:40.262900 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-897f8684-8754-458b-94f5-14d6ea25238b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:40.263336 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-897f8684-8754-458b-94f5-14d6ea25238b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:40.264116 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-897f8684-8754-458b-94f5-14d6ea25238b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:40.264572 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-897f8684-8754-458b-94f5-14d6ea25238b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:40.264998 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-897f8684-8754-458b-94f5-14d6ea25238b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:40.479108 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-bb4746ac-71a1-427b-a2c6-bb25668221f8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:40.481832 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-897f8684-8754-458b-94f5-14d6ea25238b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:40.491358 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-897f8684-8754-458b-94f5-14d6ea25238b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8" status: 200 len: 1498 microversion: 2.1 time: 0.243147 Aug 18 14:53:40.492081 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-bb4746ac-71a1-427b-a2c6-bb25668221f8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.247031 Aug 18 14:53:40.492188 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 159/308] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:40 2022] GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8 => generated 1498 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:40.492685 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 150/309] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:40 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:40.740890 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-a35083a4-32f7-43a9-81e0-dd9473c5fa60 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:40.741618 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-a35083a4-32f7-43a9-81e0-dd9473c5fa60 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: e198b9cf-f1a2-4568-831d-201df30f8dec] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:40.748346 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a35083a4-32f7-43a9-81e0-dd9473c5fa60 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:40.749011 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a35083a4-32f7-43a9-81e0-dd9473c5fa60 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:40.749530 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a35083a4-32f7-43a9-81e0-dd9473c5fa60 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:40.750333 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a35083a4-32f7-43a9-81e0-dd9473c5fa60 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:40.751062 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a35083a4-32f7-43a9-81e0-dd9473c5fa60 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:40.751548 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a35083a4-32f7-43a9-81e0-dd9473c5fa60 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:40.762983 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3f26f2d9-9f83-46a7-a543-c38940edcfb4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:40.763594 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-3f26f2d9-9f83-46a7-a543-c38940edcfb4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:40.765514 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=4 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:53:40.773921 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3f26f2d9-9f83-46a7-a543-c38940edcfb4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:40.774413 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3f26f2d9-9f83-46a7-a543-c38940edcfb4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:40.774840 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3f26f2d9-9f83-46a7-a543-c38940edcfb4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:40.775542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3f26f2d9-9f83-46a7-a543-c38940edcfb4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:40.776105 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3f26f2d9-9f83-46a7-a543-c38940edcfb4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:40.776429 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3f26f2d9-9f83-46a7-a543-c38940edcfb4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:40.873643 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_cell0:SELECT=2 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:53:41.003721 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-a35083a4-32f7-43a9-81e0-dd9473c5fa60 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:41.013373 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-a35083a4-32f7-43a9-81e0-dd9473c5fa60 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec" status: 200 len: 1318 microversion: 2.1 time: 0.276217 Aug 18 14:53:41.014520 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 160/310] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:40 2022] GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:41.020586 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-73fcdcd7-dedc-4f8a-8d49-a634c0c58756 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:41.021215 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-73fcdcd7-dedc-4f8a-8d49-a634c0c58756 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:41.028431 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-73fcdcd7-dedc-4f8a-8d49-a634c0c58756 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:41.028869 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-73fcdcd7-dedc-4f8a-8d49-a634c0c58756 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:41.029307 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-73fcdcd7-dedc-4f8a-8d49-a634c0c58756 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:41.030030 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-73fcdcd7-dedc-4f8a-8d49-a634c0c58756 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:41.030488 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-73fcdcd7-dedc-4f8a-8d49-a634c0c58756 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:41.030915 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-73fcdcd7-dedc-4f8a-8d49-a634c0c58756 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:41.034415 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-3f26f2d9-9f83-46a7-a543-c38940edcfb4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:41.046313 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-3f26f2d9-9f83-46a7-a543-c38940edcfb4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:41.048720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-3f26f2d9-9f83-46a7-a543-c38940edcfb4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:41.050273 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-3f26f2d9-9f83-46a7-a543-c38940edcfb4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.291305 Aug 18 14:53:41.051302 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 151/311] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:53:40 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:53:41.185327 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-73fcdcd7-dedc-4f8a-8d49-a634c0c58756 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:41.194172 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-73fcdcd7-dedc-4f8a-8d49-a634c0c58756 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1723 microversion: 2.1 time: 0.177448 Aug 18 14:53:41.194754 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 161/312] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:41 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:41.357242 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-aa1e349d-48e4-4d9c-a88d-bb14002d9db4 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:41.358338 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-aa1e349d-48e4-4d9c-a88d-bb14002d9db4 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 8f95123c-1e30-495d-8096-c1637bffb2e8] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:41.365024 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aa1e349d-48e4-4d9c-a88d-bb14002d9db4 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:41.365515 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aa1e349d-48e4-4d9c-a88d-bb14002d9db4 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:41.365954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aa1e349d-48e4-4d9c-a88d-bb14002d9db4 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:41.366660 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aa1e349d-48e4-4d9c-a88d-bb14002d9db4 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:41.367118 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aa1e349d-48e4-4d9c-a88d-bb14002d9db4 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:41.367548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aa1e349d-48e4-4d9c-a88d-bb14002d9db4 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:41.389436 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [req-58f2389f-3fc7-4727-859a-34b0b152c57a req-7d23881f-69e1-4f0a-a0ec-f3d060078d13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e198b9cf-f1a2-4568-831d-201df30f8dec", "name": "network-vif-plugged", "status": "completed", "tag": "2e2321a1-97a3-4bca-aea1-3514885c55c3"}]} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:53:41.397967 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-aa1e349d-48e4-4d9c-a88d-bb14002d9db4 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 8f95123c-1e30-495d-8096-c1637bffb2e8] Going to try to terminate instance {{(pid=132268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:53:41.399258 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-58f2389f-3fc7-4727-859a-34b0b152c57a req-7d23881f-69e1-4f0a-a0ec-f3d060078d13 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:41.400549 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-58f2389f-3fc7-4727-859a-34b0b152c57a req-7d23881f-69e1-4f0a-a0ec-f3d060078d13 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:41.400956 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-58f2389f-3fc7-4727-859a-34b0b152c57a req-7d23881f-69e1-4f0a-a0ec-f3d060078d13 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:41.424780 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.compute.server_external_events [req-58f2389f-3fc7-4727-859a-34b0b152c57a req-7d23881f-69e1-4f0a-a0ec-f3d060078d13 service nova] Creating event network-vif-plugged:2e2321a1-97a3-4bca-aea1-3514885c55c3 for instance e198b9cf-f1a2-4568-831d-201df30f8dec on hv-cinder-85220 Aug 18 14:53:41.429886 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [req-58f2389f-3fc7-4727-859a-34b0b152c57a req-7d23881f-69e1-4f0a-a0ec-f3d060078d13 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044086 Aug 18 14:53:41.430540 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 162/313] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:53:41.506482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-aa1e349d-48e4-4d9c-a88d-bb14002d9db4 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8" status: 204 len: 0 microversion: 2.1 time: 0.153196 Aug 18 14:53:41.507065 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 152/314] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 14:53:41 2022] DELETE /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:53:41.516172 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-d28d021e-17d5-420b-929d-a639640e9dca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:41.516795 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-d28d021e-17d5-420b-929d-a639640e9dca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:41.517416 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-7780c751-a475-485c-a924-b40120d85f39 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:41.518106 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-7780c751-a475-485c-a924-b40120d85f39 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 8f95123c-1e30-495d-8096-c1637bffb2e8] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:41.523063 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d28d021e-17d5-420b-929d-a639640e9dca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:41.523548 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d28d021e-17d5-420b-929d-a639640e9dca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:41.524010 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d28d021e-17d5-420b-929d-a639640e9dca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:41.524180 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7780c751-a475-485c-a924-b40120d85f39 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:41.524745 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d28d021e-17d5-420b-929d-a639640e9dca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:41.524922 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7780c751-a475-485c-a924-b40120d85f39 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:41.525224 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7780c751-a475-485c-a924-b40120d85f39 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:41.525366 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d28d021e-17d5-420b-929d-a639640e9dca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:41.525601 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d28d021e-17d5-420b-929d-a639640e9dca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:41.525860 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7780c751-a475-485c-a924-b40120d85f39 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:41.526307 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7780c751-a475-485c-a924-b40120d85f39 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:41.527238 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7780c751-a475-485c-a924-b40120d85f39 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:41.541976 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:53:41.679743 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-d28d021e-17d5-420b-929d-a639640e9dca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:41.688584 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-d28d021e-17d5-420b-929d-a639640e9dca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.178060 Aug 18 14:53:41.689289 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 163/315] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:41 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:41.810247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-7780c751-a475-485c-a924-b40120d85f39 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:41.818237 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-7780c751-a475-485c-a924-b40120d85f39 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8" status: 200 len: 1504 microversion: 2.1 time: 0.305529 Aug 18 14:53:41.818797 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 153/316] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:41 2022] GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8 => generated 1504 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:42.035932 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-ad90a1f9-ef0d-4341-a80e-a5214f9c8f52 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:42.036553 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-ad90a1f9-ef0d-4341-a80e-a5214f9c8f52 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: e198b9cf-f1a2-4568-831d-201df30f8dec] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:42.050023 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ad90a1f9-ef0d-4341-a80e-a5214f9c8f52 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:42.050517 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ad90a1f9-ef0d-4341-a80e-a5214f9c8f52 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:42.050949 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ad90a1f9-ef0d-4341-a80e-a5214f9c8f52 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:42.051896 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ad90a1f9-ef0d-4341-a80e-a5214f9c8f52 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:42.052353 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ad90a1f9-ef0d-4341-a80e-a5214f9c8f52 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:42.052771 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ad90a1f9-ef0d-4341-a80e-a5214f9c8f52 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:42.078554 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ab26e266-c307-4bc5-a700-0fd7554f4af8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:42.079279 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ab26e266-c307-4bc5-a700-0fd7554f4af8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:42.081328 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=18 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:53:42.087917 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ab26e266-c307-4bc5-a700-0fd7554f4af8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:42.088651 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ab26e266-c307-4bc5-a700-0fd7554f4af8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:42.089229 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ab26e266-c307-4bc5-a700-0fd7554f4af8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:42.090062 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ab26e266-c307-4bc5-a700-0fd7554f4af8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:42.090595 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ab26e266-c307-4bc5-a700-0fd7554f4af8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:42.091134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ab26e266-c307-4bc5-a700-0fd7554f4af8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:42.107190 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:53:42.273716 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-ad90a1f9-ef0d-4341-a80e-a5214f9c8f52 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:42.280543 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ab26e266-c307-4bc5-a700-0fd7554f4af8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:42.288204 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-ad90a1f9-ef0d-4341-a80e-a5214f9c8f52 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec" status: 200 len: 1318 microversion: 2.1 time: 0.256057 Aug 18 14:53:42.288736 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ab26e266-c307-4bc5-a700-0fd7554f4af8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:42.288878 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 164/317] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:42 2022] GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:42.290395 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ab26e266-c307-4bc5-a700-0fd7554f4af8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:42.291552 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-ab26e266-c307-4bc5-a700-0fd7554f4af8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.216947 Aug 18 14:53:42.292279 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 154/318] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:53:42 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:53:42.293216 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-ab48c8b9-a8b0-42e5-87cd-480adb9381a5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:42.293829 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-ab48c8b9-a8b0-42e5-87cd-480adb9381a5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:42.302212 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ab48c8b9-a8b0-42e5-87cd-480adb9381a5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:42.302696 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ab48c8b9-a8b0-42e5-87cd-480adb9381a5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:42.303133 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ab48c8b9-a8b0-42e5-87cd-480adb9381a5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:42.303925 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ab48c8b9-a8b0-42e5-87cd-480adb9381a5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:42.304389 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ab48c8b9-a8b0-42e5-87cd-480adb9381a5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:42.304807 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ab48c8b9-a8b0-42e5-87cd-480adb9381a5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:42.445109 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-ab48c8b9-a8b0-42e5-87cd-480adb9381a5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:42.455789 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-ab48c8b9-a8b0-42e5-87cd-480adb9381a5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1723 microversion: 2.1 time: 0.165911 Aug 18 14:53:42.456358 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 165/319] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:42 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:42.711407 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a997d9c3-1767-4b6a-9a87-c6da23a28149 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:42.712047 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a997d9c3-1767-4b6a-9a87-c6da23a28149 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:42.718444 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a997d9c3-1767-4b6a-9a87-c6da23a28149 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:42.718925 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a997d9c3-1767-4b6a-9a87-c6da23a28149 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:42.719357 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a997d9c3-1767-4b6a-9a87-c6da23a28149 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:42.720143 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a997d9c3-1767-4b6a-9a87-c6da23a28149 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:42.720596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a997d9c3-1767-4b6a-9a87-c6da23a28149 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:42.721017 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a997d9c3-1767-4b6a-9a87-c6da23a28149 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:42.839091 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-1bab2a0d-b13d-4268-a3f5-72382e1446fb tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:42.839722 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-1bab2a0d-b13d-4268-a3f5-72382e1446fb tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 8f95123c-1e30-495d-8096-c1637bffb2e8] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:42.846092 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1bab2a0d-b13d-4268-a3f5-72382e1446fb tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:42.846566 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1bab2a0d-b13d-4268-a3f5-72382e1446fb tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:42.846995 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1bab2a0d-b13d-4268-a3f5-72382e1446fb tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:42.847695 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1bab2a0d-b13d-4268-a3f5-72382e1446fb tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:42.848147 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1bab2a0d-b13d-4268-a3f5-72382e1446fb tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:42.848561 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1bab2a0d-b13d-4268-a3f5-72382e1446fb tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:42.857770 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a997d9c3-1767-4b6a-9a87-c6da23a28149 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:42.865544 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a997d9c3-1767-4b6a-9a87-c6da23a28149 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.157907 Aug 18 14:53:42.866087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 155/320] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:42 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:42.990087 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-1bab2a0d-b13d-4268-a3f5-72382e1446fb tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:42.999926 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-1bab2a0d-b13d-4268-a3f5-72382e1446fb tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8" status: 200 len: 1504 microversion: 2.1 time: 0.164561 Aug 18 14:53:43.000584 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 166/321] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:42 2022] GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8 => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:43.309188 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b69761c0-55ae-41aa-96cb-c5cbff759f7d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:43.309728 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b69761c0-55ae-41aa-96cb-c5cbff759f7d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: e198b9cf-f1a2-4568-831d-201df30f8dec] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:43.314516 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-612150fd-a536-4ef3-9846-5dd54f95507e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:43.315237 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-612150fd-a536-4ef3-9846-5dd54f95507e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:43.316106 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b69761c0-55ae-41aa-96cb-c5cbff759f7d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:43.316589 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b69761c0-55ae-41aa-96cb-c5cbff759f7d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:43.317013 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b69761c0-55ae-41aa-96cb-c5cbff759f7d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:43.317709 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b69761c0-55ae-41aa-96cb-c5cbff759f7d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:43.318174 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b69761c0-55ae-41aa-96cb-c5cbff759f7d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:43.318590 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b69761c0-55ae-41aa-96cb-c5cbff759f7d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:43.322106 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-612150fd-a536-4ef3-9846-5dd54f95507e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:43.322707 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-612150fd-a536-4ef3-9846-5dd54f95507e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:43.323215 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-612150fd-a536-4ef3-9846-5dd54f95507e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:43.324033 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-612150fd-a536-4ef3-9846-5dd54f95507e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:43.324570 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-612150fd-a536-4ef3-9846-5dd54f95507e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:43.325067 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-612150fd-a536-4ef3-9846-5dd54f95507e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:43.519530 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b69761c0-55ae-41aa-96cb-c5cbff759f7d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:43.527149 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-612150fd-a536-4ef3-9846-5dd54f95507e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:43.528720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b69761c0-55ae-41aa-96cb-c5cbff759f7d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec" status: 200 len: 1318 microversion: 2.1 time: 0.223470 Aug 18 14:53:43.529305 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 156/322] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:43 2022] GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:43.533920 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-67846ce4-cbf0-4455-b72e-219c6f587ad3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:43.534522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-67846ce4-cbf0-4455-b72e-219c6f587ad3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:43.535943 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-612150fd-a536-4ef3-9846-5dd54f95507e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:43.536424 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:53:43.537870 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-612150fd-a536-4ef3-9846-5dd54f95507e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:43.540607 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-612150fd-a536-4ef3-9846-5dd54f95507e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.229116 Aug 18 14:53:43.542951 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-67846ce4-cbf0-4455-b72e-219c6f587ad3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:43.543625 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-67846ce4-cbf0-4455-b72e-219c6f587ad3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:43.544091 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-67846ce4-cbf0-4455-b72e-219c6f587ad3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:43.544801 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-67846ce4-cbf0-4455-b72e-219c6f587ad3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:43.545260 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-67846ce4-cbf0-4455-b72e-219c6f587ad3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:43.545689 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-67846ce4-cbf0-4455-b72e-219c6f587ad3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:43.549627 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 167/323] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:53:43 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:53:43.680799 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-67846ce4-cbf0-4455-b72e-219c6f587ad3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:43.689371 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-67846ce4-cbf0-4455-b72e-219c6f587ad3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1723 microversion: 2.1 time: 0.159032 Aug 18 14:53:43.689934 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 157/324] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:43 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:43.890213 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-60a3218e-746b-4d6c-93da-aa7a810816c1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:43.890755 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-60a3218e-746b-4d6c-93da-aa7a810816c1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:43.897541 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-60a3218e-746b-4d6c-93da-aa7a810816c1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:43.898024 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-60a3218e-746b-4d6c-93da-aa7a810816c1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:43.898450 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-60a3218e-746b-4d6c-93da-aa7a810816c1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:43.899282 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-60a3218e-746b-4d6c-93da-aa7a810816c1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:43.901215 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-60a3218e-746b-4d6c-93da-aa7a810816c1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:43.901663 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-60a3218e-746b-4d6c-93da-aa7a810816c1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:44.021888 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8e11d4ba-1978-45ba-85fe-a039b440db0b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:44.023138 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-8e11d4ba-1978-45ba-85fe-a039b440db0b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 8f95123c-1e30-495d-8096-c1637bffb2e8] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:44.036655 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8e11d4ba-1978-45ba-85fe-a039b440db0b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:44.037113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8e11d4ba-1978-45ba-85fe-a039b440db0b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:44.037545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8e11d4ba-1978-45ba-85fe-a039b440db0b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:44.038250 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8e11d4ba-1978-45ba-85fe-a039b440db0b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:44.038701 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8e11d4ba-1978-45ba-85fe-a039b440db0b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:44.039189 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8e11d4ba-1978-45ba-85fe-a039b440db0b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:44.072673 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-60a3218e-746b-4d6c-93da-aa7a810816c1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:44.080922 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-60a3218e-746b-4d6c-93da-aa7a810816c1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.197760 Aug 18 14:53:44.085474 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 168/325] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:43 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:44.182647 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8e11d4ba-1978-45ba-85fe-a039b440db0b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:44.191066 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-8e11d4ba-1978-45ba-85fe-a039b440db0b tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8" status: 200 len: 1504 microversion: 2.1 time: 0.172923 Aug 18 14:53:44.191636 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 158/326] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:44 2022] GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8 => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:44.550684 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-ad7f8fa2-1769-4dc6-adfb-35a8d0ddf481 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:44.551220 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-ad7f8fa2-1769-4dc6-adfb-35a8d0ddf481 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: e198b9cf-f1a2-4568-831d-201df30f8dec] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:44.557977 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ad7f8fa2-1769-4dc6-adfb-35a8d0ddf481 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:44.558456 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ad7f8fa2-1769-4dc6-adfb-35a8d0ddf481 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:44.558949 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ad7f8fa2-1769-4dc6-adfb-35a8d0ddf481 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:44.559590 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ad7f8fa2-1769-4dc6-adfb-35a8d0ddf481 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:44.560077 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ad7f8fa2-1769-4dc6-adfb-35a8d0ddf481 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:44.560499 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ad7f8fa2-1769-4dc6-adfb-35a8d0ddf481 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:44.574734 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2f81f4fe-f298-4c23-a256-9889010fef5b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:44.575348 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2f81f4fe-f298-4c23-a256-9889010fef5b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:44.581346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2f81f4fe-f298-4c23-a256-9889010fef5b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:44.581877 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2f81f4fe-f298-4c23-a256-9889010fef5b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:44.582413 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2f81f4fe-f298-4c23-a256-9889010fef5b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:44.583213 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2f81f4fe-f298-4c23-a256-9889010fef5b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:44.583670 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2f81f4fe-f298-4c23-a256-9889010fef5b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:44.584118 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2f81f4fe-f298-4c23-a256-9889010fef5b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:44.801173 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-ad7f8fa2-1769-4dc6-adfb-35a8d0ddf481 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:44.809402 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-ad7f8fa2-1769-4dc6-adfb-35a8d0ddf481 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec" status: 200 len: 1318 microversion: 2.1 time: 0.262734 Aug 18 14:53:44.810204 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 169/327] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:44 2022] GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:44.826442 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2f81f4fe-f298-4c23-a256-9889010fef5b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:44.827657 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-74110c77-54ff-42de-a2cf-205c8a080f17 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:44.828273 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-74110c77-54ff-42de-a2cf-205c8a080f17 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:44.835711 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-74110c77-54ff-42de-a2cf-205c8a080f17 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:44.836270 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-74110c77-54ff-42de-a2cf-205c8a080f17 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:44.837386 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-74110c77-54ff-42de-a2cf-205c8a080f17 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:44.838090 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-74110c77-54ff-42de-a2cf-205c8a080f17 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:44.838914 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-74110c77-54ff-42de-a2cf-205c8a080f17 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:44.839241 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-74110c77-54ff-42de-a2cf-205c8a080f17 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:44.842325 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2f81f4fe-f298-4c23-a256-9889010fef5b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:44.842886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2f81f4fe-f298-4c23-a256-9889010fef5b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:44.844656 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2f81f4fe-f298-4c23-a256-9889010fef5b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.273428 Aug 18 14:53:44.845312 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 159/328] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:53:44 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:53:45.104995 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-57184e93-d36d-4032-8a15-03f6ab01310b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:45.106080 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-57184e93-d36d-4032-8a15-03f6ab01310b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:45.113986 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57184e93-d36d-4032-8a15-03f6ab01310b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:45.114522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57184e93-d36d-4032-8a15-03f6ab01310b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:45.114966 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57184e93-d36d-4032-8a15-03f6ab01310b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:45.115799 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57184e93-d36d-4032-8a15-03f6ab01310b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:45.116258 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57184e93-d36d-4032-8a15-03f6ab01310b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:45.116684 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57184e93-d36d-4032-8a15-03f6ab01310b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:45.189785 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-74110c77-54ff-42de-a2cf-205c8a080f17 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:45.199900 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-74110c77-54ff-42de-a2cf-205c8a080f17 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1723 microversion: 2.1 time: 0.375929 Aug 18 14:53:45.200833 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 170/329] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:44 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1723 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:45.222439 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-797c4dd0-cf70-427a-b77c-ddc8a95197f0 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:45.223516 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-797c4dd0-cf70-427a-b77c-ddc8a95197f0 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 8f95123c-1e30-495d-8096-c1637bffb2e8] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:45.230161 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-797c4dd0-cf70-427a-b77c-ddc8a95197f0 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:45.230781 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-797c4dd0-cf70-427a-b77c-ddc8a95197f0 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:45.231221 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-797c4dd0-cf70-427a-b77c-ddc8a95197f0 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:45.231958 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-797c4dd0-cf70-427a-b77c-ddc8a95197f0 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:45.232520 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-797c4dd0-cf70-427a-b77c-ddc8a95197f0 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:45.233205 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-797c4dd0-cf70-427a-b77c-ddc8a95197f0 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:45.437553 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-57184e93-d36d-4032-8a15-03f6ab01310b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:45.458004 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-57184e93-d36d-4032-8a15-03f6ab01310b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.358322 Aug 18 14:53:45.458560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 160/330] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:45 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:45.463723 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-de442348-36ab-4090-b176-0c7843554fdd tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Action: 'create', calling method: .version_select at 0x7fb2143d2820>, body: {"keypair": {"name": "tempest-keypair-457988654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJUX0jyx2PdX21Rr1cBJONW1yuXhelzWrvAd50KuJ1iVdt5RwPTXrWh/vZkeMkRVoO+ozOCCy7XR1b50uh1mqzHb0yEI5YszN6ggG6nJztzjV/YJESIjIr8h2wmGzYuNA=="}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:53:45.480475 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-de442348-36ab-4090-b176-0c7843554fdd tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Getting quotas for project 55c9fe0cbbfa47bca81668c039afc092. Resources: {'key_pairs'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:53:45.484769 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-de442348-36ab-4090-b176-0c7843554fdd tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Getting quotas for user 36dbc938bcd741f2a2b2013b6aa6f008 and project 55c9fe0cbbfa47bca81668c039afc092. Resources: {'key_pairs'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:53:45.509856 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-797c4dd0-cf70-427a-b77c-ddc8a95197f0 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:45.511649 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-de442348-36ab-4090-b176-0c7843554fdd tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051657 Aug 18 14:53:45.512463 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 161/331] 10.222.0.36 () {60 vars in 1159 bytes} [Thu Aug 18 14:53:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:53:45.518564 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-797c4dd0-cf70-427a-b77c-ddc8a95197f0 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8" status: 200 len: 1504 microversion: 2.1 time: 0.300946 Aug 18 14:53:45.519142 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 171/332] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:45 2022] GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8 => generated 1504 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:45.720763 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-1f287463-1a31-4a3e-94c2-e2c7f61fafed req-b6c123b0-bedf-48f2-8ff3-0f48521560b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f95123c-1e30-495d-8096-c1637bffb2e8", "name": "network-vif-deleted", "tag": "7ac94efe-b918-487d-8da6-7d03e8219270"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:53:45.732342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-1f287463-1a31-4a3e-94c2-e2c7f61fafed req-b6c123b0-bedf-48f2-8ff3-0f48521560b8 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:45.733019 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-1f287463-1a31-4a3e-94c2-e2c7f61fafed req-b6c123b0-bedf-48f2-8ff3-0f48521560b8 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:45.733452 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-1f287463-1a31-4a3e-94c2-e2c7f61fafed req-b6c123b0-bedf-48f2-8ff3-0f48521560b8 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:45.746008 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-1f287463-1a31-4a3e-94c2-e2c7f61fafed req-b6c123b0-bedf-48f2-8ff3-0f48521560b8 service nova] Creating event network-vif-deleted:7ac94efe-b918-487d-8da6-7d03e8219270 for instance 8f95123c-1e30-495d-8096-c1637bffb2e8 on hv-cinder-85220 Aug 18 14:53:45.751005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-1f287463-1a31-4a3e-94c2-e2c7f61fafed req-b6c123b0-bedf-48f2-8ff3-0f48521560b8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034055 Aug 18 14:53:45.751875 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 162/333] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:53:45.830472 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-b62f82c8-b3cd-47a6-bff7-c53f0cd19ae3 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:45.831090 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-b62f82c8-b3cd-47a6-bff7-c53f0cd19ae3 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: e198b9cf-f1a2-4568-831d-201df30f8dec] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:45.840725 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b62f82c8-b3cd-47a6-bff7-c53f0cd19ae3 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:45.841226 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b62f82c8-b3cd-47a6-bff7-c53f0cd19ae3 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:45.841665 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b62f82c8-b3cd-47a6-bff7-c53f0cd19ae3 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:45.842382 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b62f82c8-b3cd-47a6-bff7-c53f0cd19ae3 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:45.843001 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b62f82c8-b3cd-47a6-bff7-c53f0cd19ae3 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:45.843259 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b62f82c8-b3cd-47a6-bff7-c53f0cd19ae3 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:45.872188 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-972c6238-7764-484c-9895-7101f54dda54 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:45.873295 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-972c6238-7764-484c-9895-7101f54dda54 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:45.879998 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-972c6238-7764-484c-9895-7101f54dda54 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:45.880731 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-972c6238-7764-484c-9895-7101f54dda54 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:45.881234 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-972c6238-7764-484c-9895-7101f54dda54 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:45.882166 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-972c6238-7764-484c-9895-7101f54dda54 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:45.882711 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-972c6238-7764-484c-9895-7101f54dda54 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:45.883471 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-972c6238-7764-484c-9895-7101f54dda54 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:46.385757 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-b62f82c8-b3cd-47a6-bff7-c53f0cd19ae3 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:46.397927 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-972c6238-7764-484c-9895-7101f54dda54 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:46.400325 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-b62f82c8-b3cd-47a6-bff7-c53f0cd19ae3 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec" status: 200 len: 1318 microversion: 2.1 time: 0.573636 Aug 18 14:53:46.400919 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 172/334] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:45 2022] GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec => generated 1318 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:46.405517 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-9a158855-1e1c-483c-a0bc-e19b008186ca tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:46.406121 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-9a158855-1e1c-483c-a0bc-e19b008186ca tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:46.410301 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-972c6238-7764-484c-9895-7101f54dda54 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:46.411850 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-972c6238-7764-484c-9895-7101f54dda54 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:46.413278 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-972c6238-7764-484c-9895-7101f54dda54 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.546842 Aug 18 14:53:46.414032 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 163/335] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:53:45 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:53:46.418318 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9a158855-1e1c-483c-a0bc-e19b008186ca tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:46.418817 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9a158855-1e1c-483c-a0bc-e19b008186ca tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:46.419519 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9a158855-1e1c-483c-a0bc-e19b008186ca tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:46.420274 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9a158855-1e1c-483c-a0bc-e19b008186ca tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:46.420733 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9a158855-1e1c-483c-a0bc-e19b008186ca tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:46.421157 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9a158855-1e1c-483c-a0bc-e19b008186ca tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:46.481672 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b74a4548-1b74-4dc9-b475-9c0ef021ba42 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:46.482362 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b74a4548-1b74-4dc9-b475-9c0ef021ba42 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:46.488844 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b74a4548-1b74-4dc9-b475-9c0ef021ba42 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:46.490830 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b74a4548-1b74-4dc9-b475-9c0ef021ba42 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:46.491524 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b74a4548-1b74-4dc9-b475-9c0ef021ba42 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:46.493153 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b74a4548-1b74-4dc9-b475-9c0ef021ba42 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:46.493879 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b74a4548-1b74-4dc9-b475-9c0ef021ba42 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:46.495241 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b74a4548-1b74-4dc9-b475-9c0ef021ba42 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:46.614093 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-9a158855-1e1c-483c-a0bc-e19b008186ca tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:46.623376 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-9a158855-1e1c-483c-a0bc-e19b008186ca tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1723 microversion: 2.1 time: 0.221434 Aug 18 14:53:46.623985 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 173/336] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:46 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:46.630316 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-9b8dd5c3-ed54-4e90-b27e-f05a2a71cb24 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:46.631186 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-9b8dd5c3-ed54-4e90-b27e-f05a2a71cb24 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 8f95123c-1e30-495d-8096-c1637bffb2e8] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:46.639080 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9b8dd5c3-ed54-4e90-b27e-f05a2a71cb24 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:46.639756 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9b8dd5c3-ed54-4e90-b27e-f05a2a71cb24 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:46.640366 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9b8dd5c3-ed54-4e90-b27e-f05a2a71cb24 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:46.641364 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9b8dd5c3-ed54-4e90-b27e-f05a2a71cb24 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:46.642036 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9b8dd5c3-ed54-4e90-b27e-f05a2a71cb24 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:46.643202 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9b8dd5c3-ed54-4e90-b27e-f05a2a71cb24 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:46.684268 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9b8dd5c3-ed54-4e90-b27e-f05a2a71cb24 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:46.684787 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9b8dd5c3-ed54-4e90-b27e-f05a2a71cb24 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:46.685290 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9b8dd5c3-ed54-4e90-b27e-f05a2a71cb24 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:46.685741 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.objects.instance [None req-9b8dd5c3-ed54-4e90-b27e-f05a2a71cb24 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lazy-loading 'fault' on Instance uuid 8f95123c-1e30-495d-8096-c1637bffb2e8 {{(pid=132267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:53:46.687460 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b74a4548-1b74-4dc9-b475-9c0ef021ba42 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:46.695935 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b74a4548-1b74-4dc9-b475-9c0ef021ba42 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.221119 Aug 18 14:53:46.710203 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 164/337] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:46 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:46.730960 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-9b8dd5c3-ed54-4e90-b27e-f05a2a71cb24 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0dfb7613e1432dacbfc6011efaa0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf9864085c74207bd586b9493d91fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:46.740318 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-9b8dd5c3-ed54-4e90-b27e-f05a2a71cb24 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8" status: 200 len: 1304 microversion: 2.1 time: 0.114939 Aug 18 14:53:46.740834 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 174/338] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:46 2022] GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8 => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:47.421418 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f5dafe11-71e9-448d-8b77-f3ea80cbeca5 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:47.422024 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f5dafe11-71e9-448d-8b77-f3ea80cbeca5 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: e198b9cf-f1a2-4568-831d-201df30f8dec] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:47.428552 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f5dafe11-71e9-448d-8b77-f3ea80cbeca5 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:47.429038 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f5dafe11-71e9-448d-8b77-f3ea80cbeca5 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:47.429475 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f5dafe11-71e9-448d-8b77-f3ea80cbeca5 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:47.430171 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f5dafe11-71e9-448d-8b77-f3ea80cbeca5 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:47.431258 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f5dafe11-71e9-448d-8b77-f3ea80cbeca5 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:47.431699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f5dafe11-71e9-448d-8b77-f3ea80cbeca5 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:47.444606 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-db90e4b2-1557-4449-b74a-5b78cf6833b6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:47.445437 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-db90e4b2-1557-4449-b74a-5b78cf6833b6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:47.455615 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-db90e4b2-1557-4449-b74a-5b78cf6833b6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:47.456393 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-db90e4b2-1557-4449-b74a-5b78cf6833b6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:47.457119 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-db90e4b2-1557-4449-b74a-5b78cf6833b6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:47.458516 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-db90e4b2-1557-4449-b74a-5b78cf6833b6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:47.459254 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-db90e4b2-1557-4449-b74a-5b78cf6833b6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:47.459820 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-db90e4b2-1557-4449-b74a-5b78cf6833b6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:47.635153 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f5dafe11-71e9-448d-8b77-f3ea80cbeca5 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:47.649334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f5dafe11-71e9-448d-8b77-f3ea80cbeca5 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec" status: 200 len: 1508 microversion: 2.1 time: 0.229641 Aug 18 14:53:47.650843 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 165/339] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:47 2022] GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec => generated 1508 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:47.659476 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ea72fcef-d8ac-44d3-a3b2-98b1182c8542 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1598103831", "imageRef": "4083d76b-6b95-4ed8-8053-69a1270afbd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93c9a460-c99c-4e1d-ba82-dd7168d9fd6a"}], "security_groups": [{"name": "tempest-securitygroup--804409603"}], "key_name": "tempest-keypair-457988654", "user_data": "}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:53:47.663469 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-db90e4b2-1557-4449-b74a-5b78cf6833b6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:47.685132 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-db90e4b2-1557-4449-b74a-5b78cf6833b6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:47.686715 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-db90e4b2-1557-4449-b74a-5b78cf6833b6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:47.688204 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-db90e4b2-1557-4449-b74a-5b78cf6833b6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.254396 Aug 18 14:53:47.688763 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 175/340] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:53:47 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:53:47.693760 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-5b55a8ab-9591-445e-aad7-c7ec53abd924 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:47.694600 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-5b55a8ab-9591-445e-aad7-c7ec53abd924 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:47.701428 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5b55a8ab-9591-445e-aad7-c7ec53abd924 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:47.702171 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5b55a8ab-9591-445e-aad7-c7ec53abd924 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:47.706793 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5b55a8ab-9591-445e-aad7-c7ec53abd924 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:47.707659 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5b55a8ab-9591-445e-aad7-c7ec53abd924 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:47.708068 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5b55a8ab-9591-445e-aad7-c7ec53abd924 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:47.708497 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5b55a8ab-9591-445e-aad7-c7ec53abd924 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:47.879786 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.network.neutron [None req-ea72fcef-d8ac-44d3-a3b2-98b1182c8542 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] validate_networks() for [('93c9a460-c99c-4e1d-ba82-dd7168d9fd6a', None, None, None, None, None)] {{(pid=132268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:53:47.938065 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-5b55a8ab-9591-445e-aad7-c7ec53abd924 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:47.951026 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-5b55a8ab-9591-445e-aad7-c7ec53abd924 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1723 microversion: 2.1 time: 0.260539 Aug 18 14:53:47.951988 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 176/341] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:47 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:47.957702 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-a3627491-2ca1-4a12-b8fa-d6d67d7224bd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:47.958670 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-a3627491-2ca1-4a12-b8fa-d6d67d7224bd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:47.965380 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a3627491-2ca1-4a12-b8fa-d6d67d7224bd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:47.965879 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a3627491-2ca1-4a12-b8fa-d6d67d7224bd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:47.966309 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a3627491-2ca1-4a12-b8fa-d6d67d7224bd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:47.967018 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a3627491-2ca1-4a12-b8fa-d6d67d7224bd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:47.967648 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a3627491-2ca1-4a12-b8fa-d6d67d7224bd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:47.968395 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a3627491-2ca1-4a12-b8fa-d6d67d7224bd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:48.217422 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-a3627491-2ca1-4a12-b8fa-d6d67d7224bd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:48.240552 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-a3627491-2ca1-4a12-b8fa-d6d67d7224bd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.279400 Aug 18 14:53:48.242006 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 177/342] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:47 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:48.248559 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-12bbd6d0-a8b5-4f74-b347-114bf1f1ff89 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:48.249539 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-12bbd6d0-a8b5-4f74-b347-114bf1f1ff89 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] [instance: 8f95123c-1e30-495d-8096-c1637bffb2e8] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:48.257923 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-12bbd6d0-a8b5-4f74-b347-114bf1f1ff89 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:48.259175 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-12bbd6d0-a8b5-4f74-b347-114bf1f1ff89 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:48.259908 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-12bbd6d0-a8b5-4f74-b347-114bf1f1ff89 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:48.260996 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-12bbd6d0-a8b5-4f74-b347-114bf1f1ff89 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:48.261639 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-12bbd6d0-a8b5-4f74-b347-114bf1f1ff89 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:48.262261 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-12bbd6d0-a8b5-4f74-b347-114bf1f1ff89 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:48.280231 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.wsgi [None req-12bbd6d0-a8b5-4f74-b347-114bf1f1ff89 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] HTTP exception thrown: Instance 8f95123c-1e30-495d-8096-c1637bffb2e8 could not be found. Aug 18 14:53:48.281921 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-12bbd6d0-a8b5-4f74-b347-114bf1f1ff89 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Request method failure captured: Aug 18 14:53:48.281921 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: request: GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8 HTTP/1.1 Aug 18 14:53:48.281921 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept: application/json Aug 18 14:53:48.281921 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Accept-Encoding: identity Aug 18 14:53:48.281921 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Connection: close Aug 18 14:53:48.281921 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Length: 0 Aug 18 14:53:48.281921 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Content-Type: application/json Aug 18 14:53:48.281921 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Host: 10.222.0.36 Aug 18 14:53:48.281921 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Openstack-System-Scope: None Aug 18 14:53:48.281921 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: User-Agent: python-urllib3/1.26.11 Aug 18 14:53:48.281921 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Auth-Token: gAAAAABi_lJEHXWIpQoElG0p96TlEL_ir_gysZXK_3GiFSfoV10HmLMawDwnKiMu6ZOWWiaDO2iPf0ViJLVfTY2INTmr7HXCpNs1TCEIy9TjHD0VYqeTYPhLvSaBjmHsRWDBo1shpQ0T2vgrpbTDKporpiGPh3WYy-wRMwKbFEBsV-Dxg8whz1M Aug 18 14:53:48.281921 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Id: None Aug 18 14:53:48.281921 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Domain-Name: None Aug 18 14:53:48.281921 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Identity-Status: Confirmed Aug 18 14:53:48.281921 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Is-Admin-Project: True Aug 18 14:53:48.281921 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Id: default Aug 18 14:53:48.281921 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Domain-Name: Default Aug 18 14:53:48.281921 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Id: caf9864085c74207bd586b9493d91fe2 Aug 18 14:53:48.281921 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Project-Name: tempest-VolumesActionsTest-1692432283 Aug 18 14:53:48.281921 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Role: reader,member Aug 18 14:53:48.281921 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Roles: reader,member Aug 18 14:53:48.283418 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/caf9864085c74207bd586b9493d91fe2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/caf9864085c74207bd586b9493d91fe2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_caf9864085c74207bd586b9493d91fe2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/caf9864085c74207bd586b9493d91fe2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:53:48.283418 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant: tempest-VolumesActionsTest-1692432283 Aug 18 14:53:48.283418 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Id: caf9864085c74207bd586b9493d91fe2 Aug 18 14:53:48.283418 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-Tenant-Name: tempest-VolumesActionsTest-1692432283 Aug 18 14:53:48.283418 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User: tempest-VolumesActionsTest-1692432283-project Aug 18 14:53:48.283418 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Id: default Aug 18 14:53:48.283418 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Domain-Name: Default Aug 18 14:53:48.283418 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Id: ae0dfb7613e1432dacbfc6011efaa0ae Aug 18 14:53:48.283418 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: X-User-Name: tempest-VolumesActionsTest-1692432283-project Aug 18 14:53:48.283418 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: method: > Aug 18 14:53:48.283418 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: exception: Instance 8f95123c-1e30-495d-8096-c1637bffb2e8 could not be found. Aug 18 14:53:48.283418 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: action_args: {'id': '8f95123c-1e30-495d-8096-c1637bffb2e8'} Aug 18 14:53:48.284351 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:53:48.284351 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:53:48.284351 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:53:48.284351 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:53:48.284351 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:53:48.284351 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:53:48.284351 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:53:48.284351 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:53:48.284351 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:53:48.284351 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:53:48.284351 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f95123c-1e30-495d-8096-c1637bffb2e8 could not be found. Aug 18 14:53:48.284351 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:53:48.284351 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:53:48.284351 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:53:48.284351 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:53:48.284351 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:53:48.284351 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:53:48.284351 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:53:48.284351 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:53:48.284351 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:53:48.285796 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:53:48.285796 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:53:48.285796 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:53:48.285796 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:53:48.285796 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:53:48.285796 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:53:48.285796 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:53:48.285796 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f95123c-1e30-495d-8096-c1637bffb2e8 could not be found. Aug 18 14:53:48.285796 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:53:48.285796 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:53:48.285796 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:53:48.285796 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:53:48.285796 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:53:48.285796 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:53:48.285796 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:53:48.285796 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:53:48.285796 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f95123c-1e30-495d-8096-c1637bffb2e8 could not be found. Aug 18 14:53:48.285796 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: ERROR nova.api.openstack.wsgi Aug 18 14:53:48.287184 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-12bbd6d0-a8b5-4f74-b347-114bf1f1ff89 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] Returning 404 to user: Instance 8f95123c-1e30-495d-8096-c1637bffb2e8 could not be found. {{(pid=132267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:53:48.287184 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-12bbd6d0-a8b5-4f74-b347-114bf1f1ff89 tempest-VolumesActionsTest-1692432283 tempest-VolumesActionsTest-1692432283-project] 10.222.0.36 "GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8" status: 404 len: 111 microversion: 2.1 time: 0.039915 Aug 18 14:53:48.287184 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 178/343] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:48 2022] GET /compute/v2.1/servers/8f95123c-1e30-495d-8096-c1637bffb2e8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:53:48.453913 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-ea72fcef-d8ac-44d3-a3b2-98b1182c8542 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Flavor limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:53:48.454754 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-ea72fcef-d8ac-44d3-a3b2-98b1182c8542 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Image limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:53:48.454925 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-ea72fcef-d8ac-44d3-a3b2-98b1182c8542 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Flavor pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:53:48.455591 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-ea72fcef-d8ac-44d3-a3b2-98b1182c8542 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Image pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:53:48.456086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-ea72fcef-d8ac-44d3-a3b2-98b1182c8542 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:53:48.469506 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ea72fcef-d8ac-44d3-a3b2-98b1182c8542 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:48.469986 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ea72fcef-d8ac-44d3-a3b2-98b1182c8542 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:48.470411 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ea72fcef-d8ac-44d3-a3b2-98b1182c8542 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:48.471605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ea72fcef-d8ac-44d3-a3b2-98b1182c8542 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:48.472260 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ea72fcef-d8ac-44d3-a3b2-98b1182c8542 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:48.472995 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ea72fcef-d8ac-44d3-a3b2-98b1182c8542 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:48.498240 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-ea72fcef-d8ac-44d3-a3b2-98b1182c8542 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Getting quotas for project 55c9fe0cbbfa47bca81668c039afc092. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:53:48.506493 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-ea72fcef-d8ac-44d3-a3b2-98b1182c8542 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Getting quotas for user 36dbc938bcd741f2a2b2013b6aa6f008 and project 55c9fe0cbbfa47bca81668c039afc092. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:53:48.531120 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ea72fcef-d8ac-44d3-a3b2-98b1182c8542 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Going to run 1 instances... {{(pid=132268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:53:48.535288 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ea72fcef-d8ac-44d3-a3b2-98b1182c8542 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4083d76b-6b95-4ed8-8053-69a1270afbd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:53:48.591065 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-ea72fcef-d8ac-44d3-a3b2-98b1182c8542 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.938705 Aug 18 14:53:48.592030 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 166/344] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Aug 18 14:53:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:53:48.605349 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-2aa859f6-8004-4626-b00c-df4dc2f50c41 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:48.606111 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-2aa859f6-8004-4626-b00c-df4dc2f50c41 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:48.685518 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-2aa859f6-8004-4626-b00c-df4dc2f50c41 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:48.693826 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-2aa859f6-8004-4626-b00c-df4dc2f50c41 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1241 microversion: 2.1 time: 0.093260 Aug 18 14:53:48.694847 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 179/345] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:48 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:48.717125 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-6a8bc758-465d-4f6a-90d4-e477063317e5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:48.718091 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-6a8bc758-465d-4f6a-90d4-e477063317e5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:48.735876 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6a8bc758-465d-4f6a-90d4-e477063317e5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:48.737717 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6a8bc758-465d-4f6a-90d4-e477063317e5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:48.748678 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6a8bc758-465d-4f6a-90d4-e477063317e5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:48.750004 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6a8bc758-465d-4f6a-90d4-e477063317e5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:48.752315 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6a8bc758-465d-4f6a-90d4-e477063317e5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:48.755467 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6a8bc758-465d-4f6a-90d4-e477063317e5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:48.974090 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-d54bdcec-c0dc-459f-be23-231b08f6875c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:48.974711 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-d54bdcec-c0dc-459f-be23-231b08f6875c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:48.990597 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d54bdcec-c0dc-459f-be23-231b08f6875c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:48.991129 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d54bdcec-c0dc-459f-be23-231b08f6875c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:48.991545 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d54bdcec-c0dc-459f-be23-231b08f6875c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:48.996654 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d54bdcec-c0dc-459f-be23-231b08f6875c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:48.997138 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d54bdcec-c0dc-459f-be23-231b08f6875c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:48.998984 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d54bdcec-c0dc-459f-be23-231b08f6875c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:49.003887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6a8bc758-465d-4f6a-90d4-e477063317e5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:49.017620 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6a8bc758-465d-4f6a-90d4-e477063317e5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:49.025492 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6a8bc758-465d-4f6a-90d4-e477063317e5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:49.037401 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-6a8bc758-465d-4f6a-90d4-e477063317e5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.319797 Aug 18 14:53:49.038996 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 167/346] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:53:48 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:53:49.183413 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-d54bdcec-c0dc-459f-be23-231b08f6875c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:49.192849 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-d54bdcec-c0dc-459f-be23-231b08f6875c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1723 microversion: 2.1 time: 0.223487 Aug 18 14:53:49.193417 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 180/347] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:48 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:49.266207 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-9890cd9e-9164-4b4e-bb96-81de773dbff0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:49.266848 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-9890cd9e-9164-4b4e-bb96-81de773dbff0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:49.273191 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9890cd9e-9164-4b4e-bb96-81de773dbff0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:49.273891 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9890cd9e-9164-4b4e-bb96-81de773dbff0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:49.274908 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9890cd9e-9164-4b4e-bb96-81de773dbff0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:49.275806 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9890cd9e-9164-4b4e-bb96-81de773dbff0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:49.276261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9890cd9e-9164-4b4e-bb96-81de773dbff0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:49.276683 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9890cd9e-9164-4b4e-bb96-81de773dbff0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:49.416206 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-9890cd9e-9164-4b4e-bb96-81de773dbff0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:49.425798 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-9890cd9e-9164-4b4e-bb96-81de773dbff0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.163196 Aug 18 14:53:49.426368 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 168/348] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:49 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:49.717295 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-0a34fd47-915a-4b16-a1f9-b67255be4307 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:49.717914 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-0a34fd47-915a-4b16-a1f9-b67255be4307 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:49.724384 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0a34fd47-915a-4b16-a1f9-b67255be4307 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:49.724856 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0a34fd47-915a-4b16-a1f9-b67255be4307 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:49.726154 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0a34fd47-915a-4b16-a1f9-b67255be4307 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:49.728217 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0a34fd47-915a-4b16-a1f9-b67255be4307 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:49.728850 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0a34fd47-915a-4b16-a1f9-b67255be4307 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:49.729277 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0a34fd47-915a-4b16-a1f9-b67255be4307 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:49.751500 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_cell1:SELECT=100 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:53:49.812635 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-0a34fd47-915a-4b16-a1f9-b67255be4307 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:49.820500 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-0a34fd47-915a-4b16-a1f9-b67255be4307 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1293 microversion: 2.1 time: 0.107038 Aug 18 14:53:49.821605 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 181/349] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:49 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1293 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:50.065158 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ad055074-827e-448f-b215-3d9e2316ffb0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:50.065779 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ad055074-827e-448f-b215-3d9e2316ffb0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:50.072970 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ad055074-827e-448f-b215-3d9e2316ffb0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:50.073452 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ad055074-827e-448f-b215-3d9e2316ffb0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:50.073880 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ad055074-827e-448f-b215-3d9e2316ffb0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:50.074581 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ad055074-827e-448f-b215-3d9e2316ffb0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:50.075033 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ad055074-827e-448f-b215-3d9e2316ffb0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:50.075452 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ad055074-827e-448f-b215-3d9e2316ffb0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:50.213422 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ad055074-827e-448f-b215-3d9e2316ffb0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:50.214840 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-63667a7d-c96c-4b84-a2e9-e55796e83146 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:50.215765 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-63667a7d-c96c-4b84-a2e9-e55796e83146 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:50.222178 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-63667a7d-c96c-4b84-a2e9-e55796e83146 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:50.222308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ad055074-827e-448f-b215-3d9e2316ffb0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:50.222567 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-63667a7d-c96c-4b84-a2e9-e55796e83146 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:50.223246 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-63667a7d-c96c-4b84-a2e9-e55796e83146 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:50.223745 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ad055074-827e-448f-b215-3d9e2316ffb0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:50.223987 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-63667a7d-c96c-4b84-a2e9-e55796e83146 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:50.224590 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-63667a7d-c96c-4b84-a2e9-e55796e83146 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:50.224930 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-ad055074-827e-448f-b215-3d9e2316ffb0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.163785 Aug 18 14:53:50.225048 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-63667a7d-c96c-4b84-a2e9-e55796e83146 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:50.225543 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 169/350] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:53:50 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:53:50.379422 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-63667a7d-c96c-4b84-a2e9-e55796e83146 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:50.389720 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-63667a7d-c96c-4b84-a2e9-e55796e83146 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1723 microversion: 2.1 time: 0.179071 Aug 18 14:53:50.390374 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 182/351] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:50 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:50.446890 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b477ac67-4d09-46d6-b7fa-2022591e49df tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:50.447641 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b477ac67-4d09-46d6-b7fa-2022591e49df tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:50.455495 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b477ac67-4d09-46d6-b7fa-2022591e49df tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:50.456314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b477ac67-4d09-46d6-b7fa-2022591e49df tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:50.456956 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b477ac67-4d09-46d6-b7fa-2022591e49df tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:50.457949 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b477ac67-4d09-46d6-b7fa-2022591e49df tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:50.458604 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b477ac67-4d09-46d6-b7fa-2022591e49df tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:50.459216 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b477ac67-4d09-46d6-b7fa-2022591e49df tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:50.593479 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b477ac67-4d09-46d6-b7fa-2022591e49df tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:50.601833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b477ac67-4d09-46d6-b7fa-2022591e49df tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.158761 Aug 18 14:53:50.602926 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 170/352] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:50 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:50.843863 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-efc7dad3-b144-4f50-9458-89924598f2b8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:50.844390 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-efc7dad3-b144-4f50-9458-89924598f2b8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:50.851030 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-efc7dad3-b144-4f50-9458-89924598f2b8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:50.851532 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-efc7dad3-b144-4f50-9458-89924598f2b8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:50.851995 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-efc7dad3-b144-4f50-9458-89924598f2b8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:50.853380 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-efc7dad3-b144-4f50-9458-89924598f2b8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:50.853835 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-efc7dad3-b144-4f50-9458-89924598f2b8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:50.854295 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-efc7dad3-b144-4f50-9458-89924598f2b8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:50.920196 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-efc7dad3-b144-4f50-9458-89924598f2b8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:50.928215 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-efc7dad3-b144-4f50-9458-89924598f2b8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1293 microversion: 2.1 time: 0.088279 Aug 18 14:53:50.928786 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 183/353] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:50 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:51.263355 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f0e54e7d-bde0-48fa-8f3a-618d423476b4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:51.263992 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f0e54e7d-bde0-48fa-8f3a-618d423476b4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:51.270930 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f0e54e7d-bde0-48fa-8f3a-618d423476b4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:51.271397 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f0e54e7d-bde0-48fa-8f3a-618d423476b4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:51.271871 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f0e54e7d-bde0-48fa-8f3a-618d423476b4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:51.272594 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f0e54e7d-bde0-48fa-8f3a-618d423476b4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:51.273042 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f0e54e7d-bde0-48fa-8f3a-618d423476b4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:51.273456 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f0e54e7d-bde0-48fa-8f3a-618d423476b4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:51.417730 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-fa2731c5-e06b-47dc-93b6-6abdbbc65aa9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:51.417730 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-fa2731c5-e06b-47dc-93b6-6abdbbc65aa9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:51.423880 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fa2731c5-e06b-47dc-93b6-6abdbbc65aa9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:51.424417 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fa2731c5-e06b-47dc-93b6-6abdbbc65aa9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:51.424909 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fa2731c5-e06b-47dc-93b6-6abdbbc65aa9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:51.425686 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fa2731c5-e06b-47dc-93b6-6abdbbc65aa9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:51.426598 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fa2731c5-e06b-47dc-93b6-6abdbbc65aa9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:51.432506 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f0e54e7d-bde0-48fa-8f3a-618d423476b4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:51.435106 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fa2731c5-e06b-47dc-93b6-6abdbbc65aa9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:51.441395 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f0e54e7d-bde0-48fa-8f3a-618d423476b4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:51.442890 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f0e54e7d-bde0-48fa-8f3a-618d423476b4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:51.444099 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f0e54e7d-bde0-48fa-8f3a-618d423476b4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.184630 Aug 18 14:53:51.444657 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 171/354] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:53:51 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:53:51.590869 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-fa2731c5-e06b-47dc-93b6-6abdbbc65aa9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:51.601939 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-fa2731c5-e06b-47dc-93b6-6abdbbc65aa9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1723 microversion: 2.1 time: 0.193156 Aug 18 14:53:51.602676 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 184/355] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:51 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:51.622912 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-26012485-3be4-4975-abe6-88745f07c951 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:51.623530 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-26012485-3be4-4975-abe6-88745f07c951 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:51.629818 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26012485-3be4-4975-abe6-88745f07c951 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:51.630304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26012485-3be4-4975-abe6-88745f07c951 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:51.630736 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26012485-3be4-4975-abe6-88745f07c951 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:51.631429 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26012485-3be4-4975-abe6-88745f07c951 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:51.631931 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26012485-3be4-4975-abe6-88745f07c951 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:51.632350 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26012485-3be4-4975-abe6-88745f07c951 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:51.780014 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-26012485-3be4-4975-abe6-88745f07c951 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:51.788262 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-26012485-3be4-4975-abe6-88745f07c951 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.169153 Aug 18 14:53:51.788835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 172/356] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:51 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:51.948953 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-85a27953-f494-474d-9be9-94338eed8435 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:51.949556 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-85a27953-f494-474d-9be9-94338eed8435 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:51.956249 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-85a27953-f494-474d-9be9-94338eed8435 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:51.956735 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-85a27953-f494-474d-9be9-94338eed8435 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:51.957169 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-85a27953-f494-474d-9be9-94338eed8435 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:51.957869 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-85a27953-f494-474d-9be9-94338eed8435 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:51.958326 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-85a27953-f494-474d-9be9-94338eed8435 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:51.958752 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-85a27953-f494-474d-9be9-94338eed8435 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:52.027105 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-85a27953-f494-474d-9be9-94338eed8435 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:52.034931 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-85a27953-f494-474d-9be9-94338eed8435 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1293 microversion: 2.1 time: 0.089838 Aug 18 14:53:52.035499 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 185/357] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:51 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:52.467155 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-40f465e5-5fbe-43be-9f6f-233c65f92c2e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:52.467799 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-40f465e5-5fbe-43be-9f6f-233c65f92c2e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:52.474407 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-40f465e5-5fbe-43be-9f6f-233c65f92c2e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:52.474889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-40f465e5-5fbe-43be-9f6f-233c65f92c2e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:52.475319 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-40f465e5-5fbe-43be-9f6f-233c65f92c2e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:52.476038 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-40f465e5-5fbe-43be-9f6f-233c65f92c2e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:52.476491 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-40f465e5-5fbe-43be-9f6f-233c65f92c2e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:52.476937 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-40f465e5-5fbe-43be-9f6f-233c65f92c2e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:52.494069 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=100 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:53:52.623479 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-df10d65a-6e7c-43be-ad57-54112920ce5d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:52.624183 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-df10d65a-6e7c-43be-ad57-54112920ce5d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:52.624623 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-40f465e5-5fbe-43be-9f6f-233c65f92c2e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:52.630555 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-df10d65a-6e7c-43be-ad57-54112920ce5d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:52.631049 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-df10d65a-6e7c-43be-ad57-54112920ce5d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:52.631487 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-df10d65a-6e7c-43be-ad57-54112920ce5d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:52.632229 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-df10d65a-6e7c-43be-ad57-54112920ce5d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:52.632692 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-df10d65a-6e7c-43be-ad57-54112920ce5d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:52.633120 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-df10d65a-6e7c-43be-ad57-54112920ce5d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:52.634258 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-40f465e5-5fbe-43be-9f6f-233c65f92c2e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:52.635860 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-40f465e5-5fbe-43be-9f6f-233c65f92c2e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:52.637329 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-40f465e5-5fbe-43be-9f6f-233c65f92c2e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.174327 Aug 18 14:53:52.639727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 173/358] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:53:52 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:53:52.775131 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-df10d65a-6e7c-43be-ad57-54112920ce5d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:52.783576 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-df10d65a-6e7c-43be-ad57-54112920ce5d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1723 microversion: 2.1 time: 0.163841 Aug 18 14:53:52.784201 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 186/359] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:52 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:52.809212 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8b7f5d0a-e174-4b05-98db-b743186d39a9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:52.809863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-8b7f5d0a-e174-4b05-98db-b743186d39a9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:52.815998 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b7f5d0a-e174-4b05-98db-b743186d39a9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:52.816485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b7f5d0a-e174-4b05-98db-b743186d39a9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:52.816917 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b7f5d0a-e174-4b05-98db-b743186d39a9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:52.817613 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b7f5d0a-e174-4b05-98db-b743186d39a9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:52.818070 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b7f5d0a-e174-4b05-98db-b743186d39a9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:52.818494 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b7f5d0a-e174-4b05-98db-b743186d39a9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:52.955458 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8b7f5d0a-e174-4b05-98db-b743186d39a9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:52.963948 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-8b7f5d0a-e174-4b05-98db-b743186d39a9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.158653 Aug 18 14:53:52.964519 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 174/360] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:52 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:53.057183 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-dcaf24cf-1b16-428a-96ce-c7d80a421c65 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:53.057746 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-dcaf24cf-1b16-428a-96ce-c7d80a421c65 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:53.060520 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_api:SELECT=100 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:53:53.066524 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-dcaf24cf-1b16-428a-96ce-c7d80a421c65 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:53.067014 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-dcaf24cf-1b16-428a-96ce-c7d80a421c65 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:53.067713 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-dcaf24cf-1b16-428a-96ce-c7d80a421c65 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:53.068469 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-dcaf24cf-1b16-428a-96ce-c7d80a421c65 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:53.068937 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-dcaf24cf-1b16-428a-96ce-c7d80a421c65 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:53.069366 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-dcaf24cf-1b16-428a-96ce-c7d80a421c65 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:53.135052 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-dcaf24cf-1b16-428a-96ce-c7d80a421c65 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:53.145325 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-dcaf24cf-1b16-428a-96ce-c7d80a421c65 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1293 microversion: 2.1 time: 0.092744 Aug 18 14:53:53.145902 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 187/361] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:53 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:53.661037 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-dd84df0c-357d-47db-a74c-b8013cf3ee90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:53.661827 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-dd84df0c-357d-47db-a74c-b8013cf3ee90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:53.668390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dd84df0c-357d-47db-a74c-b8013cf3ee90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:53.668902 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dd84df0c-357d-47db-a74c-b8013cf3ee90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:53.669330 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dd84df0c-357d-47db-a74c-b8013cf3ee90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:53.670019 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dd84df0c-357d-47db-a74c-b8013cf3ee90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:53.670461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dd84df0c-357d-47db-a74c-b8013cf3ee90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:53.670874 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dd84df0c-357d-47db-a74c-b8013cf3ee90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:53.804767 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-bce24c4c-0054-4bf5-b23c-451f81a077d3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:53.806036 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-bce24c4c-0054-4bf5-b23c-451f81a077d3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:53.812210 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-bce24c4c-0054-4bf5-b23c-451f81a077d3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:53.812794 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-bce24c4c-0054-4bf5-b23c-451f81a077d3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:53.813315 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-bce24c4c-0054-4bf5-b23c-451f81a077d3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:53.814087 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-bce24c4c-0054-4bf5-b23c-451f81a077d3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:53.814616 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-bce24c4c-0054-4bf5-b23c-451f81a077d3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:53.815108 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-bce24c4c-0054-4bf5-b23c-451f81a077d3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:53.905281 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-dd84df0c-357d-47db-a74c-b8013cf3ee90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:53.913763 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-dd84df0c-357d-47db-a74c-b8013cf3ee90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:53.916748 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-dd84df0c-357d-47db-a74c-b8013cf3ee90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:53.918727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-dd84df0c-357d-47db-a74c-b8013cf3ee90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.261363 Aug 18 14:53:53.919306 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 175/362] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:53:53 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:53:53.984983 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-dde12d96-bd7a-4b44-ac7f-62a32089104b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:53.985600 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-dde12d96-bd7a-4b44-ac7f-62a32089104b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:53.991584 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dde12d96-bd7a-4b44-ac7f-62a32089104b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:53.992132 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dde12d96-bd7a-4b44-ac7f-62a32089104b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:53.992541 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dde12d96-bd7a-4b44-ac7f-62a32089104b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:53.993786 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dde12d96-bd7a-4b44-ac7f-62a32089104b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:53.994269 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dde12d96-bd7a-4b44-ac7f-62a32089104b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:53.994693 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dde12d96-bd7a-4b44-ac7f-62a32089104b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:54.029564 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-bce24c4c-0054-4bf5-b23c-451f81a077d3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:54.044049 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-bce24c4c-0054-4bf5-b23c-451f81a077d3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1723 microversion: 2.1 time: 0.243116 Aug 18 14:53:54.045205 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 188/363] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:53 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:54.167816 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-224e8e46-7194-4471-a75d-9f67820e5242 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:54.168305 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-224e8e46-7194-4471-a75d-9f67820e5242 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:54.175336 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-224e8e46-7194-4471-a75d-9f67820e5242 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:54.175923 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-224e8e46-7194-4471-a75d-9f67820e5242 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:54.176615 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-224e8e46-7194-4471-a75d-9f67820e5242 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:54.177415 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-224e8e46-7194-4471-a75d-9f67820e5242 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:54.178031 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-224e8e46-7194-4471-a75d-9f67820e5242 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:54.178454 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-224e8e46-7194-4471-a75d-9f67820e5242 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:54.234516 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-dde12d96-bd7a-4b44-ac7f-62a32089104b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:54.242373 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-dde12d96-bd7a-4b44-ac7f-62a32089104b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.261477 Aug 18 14:53:54.243998 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 176/364] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:53 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:54.278521 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-224e8e46-7194-4471-a75d-9f67820e5242 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:54.287309 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-224e8e46-7194-4471-a75d-9f67820e5242 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1299 microversion: 2.1 time: 0.124645 Aug 18 14:53:54.287921 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 189/365] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:54 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1299 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:54.942332 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f49d1824-271d-4b9f-b316-70225ebb1520 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:54.943584 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f49d1824-271d-4b9f-b316-70225ebb1520 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:54.955189 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f49d1824-271d-4b9f-b316-70225ebb1520 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:54.955766 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f49d1824-271d-4b9f-b316-70225ebb1520 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:54.956206 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f49d1824-271d-4b9f-b316-70225ebb1520 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:54.956946 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f49d1824-271d-4b9f-b316-70225ebb1520 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:54.957402 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f49d1824-271d-4b9f-b316-70225ebb1520 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:54.957824 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f49d1824-271d-4b9f-b316-70225ebb1520 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:55.066268 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-03e11e72-fb51-47fd-ae0e-93ddd5e2d93d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:55.066943 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-03e11e72-fb51-47fd-ae0e-93ddd5e2d93d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:55.075174 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-03e11e72-fb51-47fd-ae0e-93ddd5e2d93d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:55.075644 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-03e11e72-fb51-47fd-ae0e-93ddd5e2d93d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:55.076118 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-03e11e72-fb51-47fd-ae0e-93ddd5e2d93d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:55.076823 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-03e11e72-fb51-47fd-ae0e-93ddd5e2d93d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:55.077354 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-03e11e72-fb51-47fd-ae0e-93ddd5e2d93d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:55.077911 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-03e11e72-fb51-47fd-ae0e-93ddd5e2d93d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:55.211494 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f49d1824-271d-4b9f-b316-70225ebb1520 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:55.220931 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f49d1824-271d-4b9f-b316-70225ebb1520 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:55.222353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f49d1824-271d-4b9f-b316-70225ebb1520 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:55.223633 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f49d1824-271d-4b9f-b316-70225ebb1520 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.285251 Aug 18 14:53:55.224422 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 177/366] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:53:54 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:53:55.228905 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-3719f063-9dcf-4bf1-88e4-b36f93dc0b93 req-ee865c44-a49f-4b05-ba22-1798de32bbd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa15c998-af91-4654-9cf6-ee7b4b1da164", "tag": "c53b5061-6ea7-41b4-b0ac-30785ff1f9b9"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:53:55.249054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-3719f063-9dcf-4bf1-88e4-b36f93dc0b93 req-ee865c44-a49f-4b05-ba22-1798de32bbd2 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:55.249547 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-3719f063-9dcf-4bf1-88e4-b36f93dc0b93 req-ee865c44-a49f-4b05-ba22-1798de32bbd2 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:55.249991 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-3719f063-9dcf-4bf1-88e4-b36f93dc0b93 req-ee865c44-a49f-4b05-ba22-1798de32bbd2 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:55.264846 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-3719f063-9dcf-4bf1-88e4-b36f93dc0b93 req-ee865c44-a49f-4b05-ba22-1798de32bbd2 service nova] Creating event network-changed:c53b5061-6ea7-41b4-b0ac-30785ff1f9b9 for instance aa15c998-af91-4654-9cf6-ee7b4b1da164 on hv-cinder-85220 Aug 18 14:53:55.270216 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-3719f063-9dcf-4bf1-88e4-b36f93dc0b93 req-ee865c44-a49f-4b05-ba22-1798de32bbd2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044715 Aug 18 14:53:55.270820 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 178/367] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:53:55.276785 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3d6809da-f9d6-460d-b026-80729d9a2116 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:55.277497 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-3d6809da-f9d6-460d-b026-80729d9a2116 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:55.284116 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3d6809da-f9d6-460d-b026-80729d9a2116 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:55.284612 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3d6809da-f9d6-460d-b026-80729d9a2116 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:55.285049 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3d6809da-f9d6-460d-b026-80729d9a2116 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:55.285755 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3d6809da-f9d6-460d-b026-80729d9a2116 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:55.286214 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3d6809da-f9d6-460d-b026-80729d9a2116 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:55.289355 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3d6809da-f9d6-460d-b026-80729d9a2116 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:55.289491 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-03e11e72-fb51-47fd-ae0e-93ddd5e2d93d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:55.296877 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-03e11e72-fb51-47fd-ae0e-93ddd5e2d93d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1723 microversion: 2.1 time: 0.234335 Aug 18 14:53:55.301518 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 190/368] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:55 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:55.313833 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-974a7f0c-35d6-4771-8490-101a09746271 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:55.314575 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-974a7f0c-35d6-4771-8490-101a09746271 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:55.320876 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-974a7f0c-35d6-4771-8490-101a09746271 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:55.321373 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-974a7f0c-35d6-4771-8490-101a09746271 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:55.321937 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-974a7f0c-35d6-4771-8490-101a09746271 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:55.323038 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-974a7f0c-35d6-4771-8490-101a09746271 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:55.323602 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-974a7f0c-35d6-4771-8490-101a09746271 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:55.323953 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-974a7f0c-35d6-4771-8490-101a09746271 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:55.483727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-3d6809da-f9d6-460d-b026-80729d9a2116 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:55.491531 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-3d6809da-f9d6-460d-b026-80729d9a2116 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.219257 Aug 18 14:53:55.492132 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 179/369] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:55 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:55.522773 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-974a7f0c-35d6-4771-8490-101a09746271 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:55.531367 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-974a7f0c-35d6-4771-8490-101a09746271 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1366 microversion: 2.1 time: 0.224877 Aug 18 14:53:55.531984 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 191/370] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:55 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:56.247669 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8b7a44e6-4c4a-4767-8c51-033ac9c4b3e8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:56.248304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-8b7a44e6-4c4a-4767-8c51-033ac9c4b3e8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:56.254799 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b7a44e6-4c4a-4767-8c51-033ac9c4b3e8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:56.255286 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b7a44e6-4c4a-4767-8c51-033ac9c4b3e8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:56.255811 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b7a44e6-4c4a-4767-8c51-033ac9c4b3e8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:56.256516 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b7a44e6-4c4a-4767-8c51-033ac9c4b3e8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:56.256968 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b7a44e6-4c4a-4767-8c51-033ac9c4b3e8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:56.257389 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b7a44e6-4c4a-4767-8c51-033ac9c4b3e8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:56.318660 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-14cdd315-f21f-4c7b-93b9-cb06b84aa88b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:56.320031 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-14cdd315-f21f-4c7b-93b9-cb06b84aa88b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:56.328551 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-14cdd315-f21f-4c7b-93b9-cb06b84aa88b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:56.329339 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-14cdd315-f21f-4c7b-93b9-cb06b84aa88b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:56.329976 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-14cdd315-f21f-4c7b-93b9-cb06b84aa88b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:56.330943 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-14cdd315-f21f-4c7b-93b9-cb06b84aa88b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:56.331564 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-14cdd315-f21f-4c7b-93b9-cb06b84aa88b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:56.332153 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-14cdd315-f21f-4c7b-93b9-cb06b84aa88b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:56.428313 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8b7a44e6-4c4a-4767-8c51-033ac9c4b3e8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:56.437705 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8b7a44e6-4c4a-4767-8c51-033ac9c4b3e8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:56.439214 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8b7a44e6-4c4a-4767-8c51-033ac9c4b3e8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:56.440440 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-8b7a44e6-4c4a-4767-8c51-033ac9c4b3e8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.196707 Aug 18 14:53:56.440987 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 180/371] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:53:56 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:53:56.495641 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-14cdd315-f21f-4c7b-93b9-cb06b84aa88b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:56.508029 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-14cdd315-f21f-4c7b-93b9-cb06b84aa88b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1723 microversion: 2.1 time: 0.193086 Aug 18 14:53:56.514762 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 192/372] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:56 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:56.521542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3ee785cf-dd8e-45b0-b407-242b501dcc2f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:56.522160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-3ee785cf-dd8e-45b0-b407-242b501dcc2f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:56.530401 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3ee785cf-dd8e-45b0-b407-242b501dcc2f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:56.531200 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3ee785cf-dd8e-45b0-b407-242b501dcc2f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:56.531792 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3ee785cf-dd8e-45b0-b407-242b501dcc2f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:56.532502 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3ee785cf-dd8e-45b0-b407-242b501dcc2f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:56.532966 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3ee785cf-dd8e-45b0-b407-242b501dcc2f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:56.533394 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3ee785cf-dd8e-45b0-b407-242b501dcc2f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:56.552974 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-60f1ae54-0bad-4880-a5ea-c72635683aba tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:56.553570 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-60f1ae54-0bad-4880-a5ea-c72635683aba tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:56.560740 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-60f1ae54-0bad-4880-a5ea-c72635683aba tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:56.561234 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-60f1ae54-0bad-4880-a5ea-c72635683aba tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:56.561675 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-60f1ae54-0bad-4880-a5ea-c72635683aba tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:56.562384 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-60f1ae54-0bad-4880-a5ea-c72635683aba tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:56.562838 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-60f1ae54-0bad-4880-a5ea-c72635683aba tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:56.563358 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-60f1ae54-0bad-4880-a5ea-c72635683aba tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:56.743071 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-3ee785cf-dd8e-45b0-b407-242b501dcc2f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:56.751171 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-3ee785cf-dd8e-45b0-b407-242b501dcc2f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.233464 Aug 18 14:53:56.751764 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 181/373] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:56 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:56.764563 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-60f1ae54-0bad-4880-a5ea-c72635683aba tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:56.772689 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-60f1ae54-0bad-4880-a5ea-c72635683aba tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1366 microversion: 2.1 time: 0.223726 Aug 18 14:53:56.773248 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 193/374] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:56 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:57.464537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b832a710-ee1f-4b6b-a00c-5d4839eb74d6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:57.465140 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b832a710-ee1f-4b6b-a00c-5d4839eb74d6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:57.471533 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b832a710-ee1f-4b6b-a00c-5d4839eb74d6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:57.472049 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b832a710-ee1f-4b6b-a00c-5d4839eb74d6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:57.473159 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b832a710-ee1f-4b6b-a00c-5d4839eb74d6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:57.473295 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b832a710-ee1f-4b6b-a00c-5d4839eb74d6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:57.473715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b832a710-ee1f-4b6b-a00c-5d4839eb74d6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:57.474130 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b832a710-ee1f-4b6b-a00c-5d4839eb74d6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:57.535452 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-1b4d5e05-1153-4076-85d6-b8b91dc01446 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:57.536126 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-1b4d5e05-1153-4076-85d6-b8b91dc01446 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:57.542847 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1b4d5e05-1153-4076-85d6-b8b91dc01446 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:57.543352 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1b4d5e05-1153-4076-85d6-b8b91dc01446 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:57.543818 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1b4d5e05-1153-4076-85d6-b8b91dc01446 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:57.544551 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1b4d5e05-1153-4076-85d6-b8b91dc01446 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:57.545114 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1b4d5e05-1153-4076-85d6-b8b91dc01446 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:57.545796 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1b4d5e05-1153-4076-85d6-b8b91dc01446 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:57.654627 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b832a710-ee1f-4b6b-a00c-5d4839eb74d6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:57.665376 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b832a710-ee1f-4b6b-a00c-5d4839eb74d6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:57.667121 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b832a710-ee1f-4b6b-a00c-5d4839eb74d6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:57.668736 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b832a710-ee1f-4b6b-a00c-5d4839eb74d6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.208062 Aug 18 14:53:57.682050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 182/375] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:53:57 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:53:57.705858 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-1b4d5e05-1153-4076-85d6-b8b91dc01446 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:57.714768 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-1b4d5e05-1153-4076-85d6-b8b91dc01446 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1723 microversion: 2.1 time: 0.182963 Aug 18 14:53:57.715035 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 194/376] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:57 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:57.772413 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-48c66e4a-494a-4a26-92cd-a94bcdf8d2fc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:57.773056 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-48c66e4a-494a-4a26-92cd-a94bcdf8d2fc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:57.779068 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-48c66e4a-494a-4a26-92cd-a94bcdf8d2fc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:57.779587 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-48c66e4a-494a-4a26-92cd-a94bcdf8d2fc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:57.780052 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-48c66e4a-494a-4a26-92cd-a94bcdf8d2fc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:57.780876 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-48c66e4a-494a-4a26-92cd-a94bcdf8d2fc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:57.781260 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-48c66e4a-494a-4a26-92cd-a94bcdf8d2fc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:57.781737 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-48c66e4a-494a-4a26-92cd-a94bcdf8d2fc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:57.793966 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-e472ae7b-a875-4b72-87c3-4ed191271ee8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:57.794589 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-e472ae7b-a875-4b72-87c3-4ed191271ee8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:57.801185 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e472ae7b-a875-4b72-87c3-4ed191271ee8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:57.801675 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e472ae7b-a875-4b72-87c3-4ed191271ee8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:57.802114 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e472ae7b-a875-4b72-87c3-4ed191271ee8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:57.802830 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e472ae7b-a875-4b72-87c3-4ed191271ee8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:57.803288 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e472ae7b-a875-4b72-87c3-4ed191271ee8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:57.803737 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e472ae7b-a875-4b72-87c3-4ed191271ee8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:58.010741 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-48c66e4a-494a-4a26-92cd-a94bcdf8d2fc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:58.018454 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-e472ae7b-a875-4b72-87c3-4ed191271ee8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:58.019166 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-48c66e4a-494a-4a26-92cd-a94bcdf8d2fc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.250538 Aug 18 14:53:58.019762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 183/377] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:57 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:58.029149 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-e472ae7b-a875-4b72-87c3-4ed191271ee8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1366 microversion: 2.1 time: 0.238926 Aug 18 14:53:58.029780 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 195/378] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:57 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:58.695608 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-edad529e-4468-41d2-8380-672879861b8b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:58.696353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-edad529e-4468-41d2-8380-672879861b8b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:58.698838 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=2 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:53:58.699509 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=10 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:53:58.705399 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-edad529e-4468-41d2-8380-672879861b8b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:58.705898 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-edad529e-4468-41d2-8380-672879861b8b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:58.706336 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-edad529e-4468-41d2-8380-672879861b8b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:58.707090 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-edad529e-4468-41d2-8380-672879861b8b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:58.707549 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-edad529e-4468-41d2-8380-672879861b8b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:58.709103 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-edad529e-4468-41d2-8380-672879861b8b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:58.737697 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-1c9ac544-1a59-4d24-87ab-ea4c13b1ef9b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:58.739009 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-1c9ac544-1a59-4d24-87ab-ea4c13b1ef9b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:58.744044 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_cell0:SELECT=2 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:53:58.747943 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1c9ac544-1a59-4d24-87ab-ea4c13b1ef9b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:58.748720 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1c9ac544-1a59-4d24-87ab-ea4c13b1ef9b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:58.749386 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1c9ac544-1a59-4d24-87ab-ea4c13b1ef9b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:58.750304 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1c9ac544-1a59-4d24-87ab-ea4c13b1ef9b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:58.750765 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1c9ac544-1a59-4d24-87ab-ea4c13b1ef9b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:58.751188 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1c9ac544-1a59-4d24-87ab-ea4c13b1ef9b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:58.939481 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-edad529e-4468-41d2-8380-672879861b8b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:58.952024 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-edad529e-4468-41d2-8380-672879861b8b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:58.953381 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-1c9ac544-1a59-4d24-87ab-ea4c13b1ef9b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:58.953911 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-edad529e-4468-41d2-8380-672879861b8b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:58.955222 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-edad529e-4468-41d2-8380-672879861b8b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.263529 Aug 18 14:53:58.955984 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 184/379] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:53:58 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:53:58.962489 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-1c9ac544-1a59-4d24-87ab-ea4c13b1ef9b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1723 microversion: 2.1 time: 0.229170 Aug 18 14:53:58.963052 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 196/380] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:58 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:53:59.045335 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-aa407cac-e3fb-47fe-b4df-2f68b2ededad tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:59.046183 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-aa407cac-e3fb-47fe-b4df-2f68b2ededad tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:59.051799 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-c3413019-55c7-45e3-ada9-a743f92ff3b7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:59.052422 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-c3413019-55c7-45e3-ada9-a743f92ff3b7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:59.055171 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aa407cac-e3fb-47fe-b4df-2f68b2ededad tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:59.055759 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aa407cac-e3fb-47fe-b4df-2f68b2ededad tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:59.056286 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aa407cac-e3fb-47fe-b4df-2f68b2ededad tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:59.057061 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aa407cac-e3fb-47fe-b4df-2f68b2ededad tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:59.057584 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aa407cac-e3fb-47fe-b4df-2f68b2ededad tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:59.058011 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aa407cac-e3fb-47fe-b4df-2f68b2ededad tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:59.058415 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c3413019-55c7-45e3-ada9-a743f92ff3b7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:59.058895 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c3413019-55c7-45e3-ada9-a743f92ff3b7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:59.059322 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c3413019-55c7-45e3-ada9-a743f92ff3b7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:59.060038 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c3413019-55c7-45e3-ada9-a743f92ff3b7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:59.060488 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c3413019-55c7-45e3-ada9-a743f92ff3b7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:59.060906 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c3413019-55c7-45e3-ada9-a743f92ff3b7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:59.489620 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-aa407cac-e3fb-47fe-b4df-2f68b2ededad tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:59.497853 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-c3413019-55c7-45e3-ada9-a743f92ff3b7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:53:59.500180 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-aa407cac-e3fb-47fe-b4df-2f68b2ededad tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.459680 Aug 18 14:53:59.502216 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 185/381] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:59 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:59.506516 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-c3413019-55c7-45e3-ada9-a743f92ff3b7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1366 microversion: 2.1 time: 0.459571 Aug 18 14:53:59.507258 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 197/382] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:59 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1366 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:53:59.977951 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3fb4428e-41a7-4c43-b421-aa4e53bdf627 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:59.978564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-3fb4428e-41a7-4c43-b421-aa4e53bdf627 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:59.983392 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-4e991a70-f5f0-4c8a-8138-3e10bb21146f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:53:59.984034 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-4e991a70-f5f0-4c8a-8138-3e10bb21146f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:53:59.985174 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3fb4428e-41a7-4c43-b421-aa4e53bdf627 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:59.985666 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3fb4428e-41a7-4c43-b421-aa4e53bdf627 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:59.986097 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3fb4428e-41a7-4c43-b421-aa4e53bdf627 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:59.986799 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3fb4428e-41a7-4c43-b421-aa4e53bdf627 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:59.987253 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3fb4428e-41a7-4c43-b421-aa4e53bdf627 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:59.987673 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3fb4428e-41a7-4c43-b421-aa4e53bdf627 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:59.990544 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4e991a70-f5f0-4c8a-8138-3e10bb21146f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:59.991020 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4e991a70-f5f0-4c8a-8138-3e10bb21146f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:59.991461 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4e991a70-f5f0-4c8a-8138-3e10bb21146f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:59.992170 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4e991a70-f5f0-4c8a-8138-3e10bb21146f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:53:59.993140 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4e991a70-f5f0-4c8a-8138-3e10bb21146f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:53:59.993571 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4e991a70-f5f0-4c8a-8138-3e10bb21146f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:53:59.996331 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_cell1:SELECT=100 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:54:00.194693 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-4e991a70-f5f0-4c8a-8138-3e10bb21146f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:00.198073 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-3fb4428e-41a7-4c43-b421-aa4e53bdf627 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:00.204434 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-4e991a70-f5f0-4c8a-8138-3e10bb21146f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1723 microversion: 2.1 time: 0.224799 Aug 18 14:54:00.205156 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 198/383] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:53:59 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:54:00.206888 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-3fb4428e-41a7-4c43-b421-aa4e53bdf627 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:00.208416 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-3fb4428e-41a7-4c43-b421-aa4e53bdf627 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:00.209588 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-3fb4428e-41a7-4c43-b421-aa4e53bdf627 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.235622 Aug 18 14:54:00.210129 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 186/384] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:53:59 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:00.523802 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-bffb3cdb-56fb-4062-bd0b-dfb77513e5d3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:00.525387 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-bffb3cdb-56fb-4062-bd0b-dfb77513e5d3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:00.527900 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f60ed055-80d2-425b-84d6-c67706af3fd7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:00.528669 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f60ed055-80d2-425b-84d6-c67706af3fd7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:00.534789 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f60ed055-80d2-425b-84d6-c67706af3fd7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:00.535249 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-bffb3cdb-56fb-4062-bd0b-dfb77513e5d3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:00.535395 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f60ed055-80d2-425b-84d6-c67706af3fd7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:00.536090 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-bffb3cdb-56fb-4062-bd0b-dfb77513e5d3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:00.536390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f60ed055-80d2-425b-84d6-c67706af3fd7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:00.536792 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-bffb3cdb-56fb-4062-bd0b-dfb77513e5d3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:00.537373 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f60ed055-80d2-425b-84d6-c67706af3fd7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:00.537912 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-bffb3cdb-56fb-4062-bd0b-dfb77513e5d3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:00.538078 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f60ed055-80d2-425b-84d6-c67706af3fd7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:00.538474 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f60ed055-80d2-425b-84d6-c67706af3fd7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:00.538684 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-bffb3cdb-56fb-4062-bd0b-dfb77513e5d3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:00.539402 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-bffb3cdb-56fb-4062-bd0b-dfb77513e5d3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:00.843492 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f60ed055-80d2-425b-84d6-c67706af3fd7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:00.847579 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-bffb3cdb-56fb-4062-bd0b-dfb77513e5d3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:00.852037 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f60ed055-80d2-425b-84d6-c67706af3fd7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1366 microversion: 2.1 time: 0.328718 Aug 18 14:54:00.852448 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 187/385] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:00 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1366 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:54:00.862392 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-bffb3cdb-56fb-4062-bd0b-dfb77513e5d3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.339684 Aug 18 14:54:00.862392 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 199/386] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:00 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:01.225678 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-fa243283-d2f8-4ff6-957a-7445c911365c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:01.226345 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-fa243283-d2f8-4ff6-957a-7445c911365c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:01.233143 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fa243283-d2f8-4ff6-957a-7445c911365c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:01.233332 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-498a8fa1-d684-4a76-824d-239bcb10d0da tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:01.233749 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fa243283-d2f8-4ff6-957a-7445c911365c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:01.233860 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-498a8fa1-d684-4a76-824d-239bcb10d0da tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:01.234053 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fa243283-d2f8-4ff6-957a-7445c911365c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:01.234746 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fa243283-d2f8-4ff6-957a-7445c911365c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:01.235200 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fa243283-d2f8-4ff6-957a-7445c911365c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:01.235628 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fa243283-d2f8-4ff6-957a-7445c911365c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:01.240791 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-498a8fa1-d684-4a76-824d-239bcb10d0da tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:01.241371 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-498a8fa1-d684-4a76-824d-239bcb10d0da tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:01.241791 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-498a8fa1-d684-4a76-824d-239bcb10d0da tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:01.243141 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-498a8fa1-d684-4a76-824d-239bcb10d0da tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:01.243575 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-498a8fa1-d684-4a76-824d-239bcb10d0da tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:01.243953 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-498a8fa1-d684-4a76-824d-239bcb10d0da tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:01.493976 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-fa243283-d2f8-4ff6-957a-7445c911365c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:01.502495 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-fa243283-d2f8-4ff6-957a-7445c911365c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1700 microversion: 2.1 time: 0.280617 Aug 18 14:54:01.502666 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-498a8fa1-d684-4a76-824d-239bcb10d0da tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:01.503405 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 200/387] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:01 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1700 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:01.512016 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-498a8fa1-d684-4a76-824d-239bcb10d0da tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:01.513504 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-498a8fa1-d684-4a76-824d-239bcb10d0da tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:01.514657 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-498a8fa1-d684-4a76-824d-239bcb10d0da tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1744 microversion: 2.20 time: 0.285585 Aug 18 14:54:01.515211 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 188/388] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:01 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1744 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:54:01.524162 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-19afa4e5-d5be-4040-815f-458515719307 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:54:01.530726 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-19afa4e5-d5be-4040-815f-458515719307 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:01.531213 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-19afa4e5-d5be-4040-815f-458515719307 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:01.531693 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-19afa4e5-d5be-4040-815f-458515719307 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:01.554408 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-19afa4e5-d5be-4040-815f-458515719307 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Going to try to start instance {{(pid=132267) start /opt/stack/nova/nova/compute/api.py:2775}} Aug 18 14:54:01.598864 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-19afa4e5-d5be-4040-815f-458515719307 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "POST /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5/action" status: 202 len: 0 microversion: 2.1 time: 0.078369 Aug 18 14:54:01.599494 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 201/389] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Aug 18 14:54:01 2022] POST /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:54:01.608041 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0071c3ce-146b-429b-9faf-6372c31230f5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:01.608647 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0071c3ce-146b-429b-9faf-6372c31230f5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:01.614559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0071c3ce-146b-429b-9faf-6372c31230f5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:01.615043 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0071c3ce-146b-429b-9faf-6372c31230f5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:01.615469 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0071c3ce-146b-429b-9faf-6372c31230f5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:01.616186 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0071c3ce-146b-429b-9faf-6372c31230f5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:01.616634 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0071c3ce-146b-429b-9faf-6372c31230f5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:01.617060 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0071c3ce-146b-429b-9faf-6372c31230f5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:01.752371 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-0071c3ce-146b-429b-9faf-6372c31230f5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:01.761035 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0071c3ce-146b-429b-9faf-6372c31230f5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1709 microversion: 2.1 time: 0.156735 Aug 18 14:54:01.761607 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 189/390] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:01 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1709 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:01.873855 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-8eb48986-283a-4b8c-9f84-2027b7f1b858 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:01.874591 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-8eb48986-283a-4b8c-9f84-2027b7f1b858 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:01.877713 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3f2e6094-1c5c-45c0-b97c-0ba1489d70db tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:01.878055 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-3f2e6094-1c5c-45c0-b97c-0ba1489d70db tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:01.882695 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8eb48986-283a-4b8c-9f84-2027b7f1b858 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:01.883226 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8eb48986-283a-4b8c-9f84-2027b7f1b858 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:01.883959 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8eb48986-283a-4b8c-9f84-2027b7f1b858 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:01.884398 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3f2e6094-1c5c-45c0-b97c-0ba1489d70db tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:01.884663 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8eb48986-283a-4b8c-9f84-2027b7f1b858 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:01.885024 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3f2e6094-1c5c-45c0-b97c-0ba1489d70db tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:01.885144 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8eb48986-283a-4b8c-9f84-2027b7f1b858 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:01.885465 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3f2e6094-1c5c-45c0-b97c-0ba1489d70db tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:01.885569 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8eb48986-283a-4b8c-9f84-2027b7f1b858 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:01.886190 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3f2e6094-1c5c-45c0-b97c-0ba1489d70db tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:01.886644 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3f2e6094-1c5c-45c0-b97c-0ba1489d70db tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:01.887064 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3f2e6094-1c5c-45c0-b97c-0ba1489d70db tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:02.092556 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-8eb48986-283a-4b8c-9f84-2027b7f1b858 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:02.096796 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-3f2e6094-1c5c-45c0-b97c-0ba1489d70db tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:02.099170 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=100 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:54:02.100631 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-8eb48986-283a-4b8c-9f84-2027b7f1b858 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1366 microversion: 2.1 time: 0.231044 Aug 18 14:54:02.101256 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 202/391] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:01 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:02.107130 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-3f2e6094-1c5c-45c0-b97c-0ba1489d70db tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.233776 Aug 18 14:54:02.107867 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 190/392] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:01 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:54:02.537990 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-62e4ea24-bdfe-475b-85a7-af7dca084901 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:02.538603 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-62e4ea24-bdfe-475b-85a7-af7dca084901 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:02.545113 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-62e4ea24-bdfe-475b-85a7-af7dca084901 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:02.545650 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-62e4ea24-bdfe-475b-85a7-af7dca084901 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:02.546036 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-62e4ea24-bdfe-475b-85a7-af7dca084901 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:02.546734 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-62e4ea24-bdfe-475b-85a7-af7dca084901 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:02.547192 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-62e4ea24-bdfe-475b-85a7-af7dca084901 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:02.547629 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-62e4ea24-bdfe-475b-85a7-af7dca084901 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:02.712336 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-62e4ea24-bdfe-475b-85a7-af7dca084901 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:02.722455 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-62e4ea24-bdfe-475b-85a7-af7dca084901 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:02.724130 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-62e4ea24-bdfe-475b-85a7-af7dca084901 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:02.725434 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-62e4ea24-bdfe-475b-85a7-af7dca084901 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1744 microversion: 2.20 time: 0.191483 Aug 18 14:54:02.726425 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 203/393] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:02 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1744 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:02.782711 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f1161b81-02a3-48de-a1c2-30c7fc8799c2 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:02.783427 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f1161b81-02a3-48de-a1c2-30c7fc8799c2 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:02.790707 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f1161b81-02a3-48de-a1c2-30c7fc8799c2 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:02.791230 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f1161b81-02a3-48de-a1c2-30c7fc8799c2 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:02.791765 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f1161b81-02a3-48de-a1c2-30c7fc8799c2 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:02.792576 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f1161b81-02a3-48de-a1c2-30c7fc8799c2 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:02.793140 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f1161b81-02a3-48de-a1c2-30c7fc8799c2 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:02.793632 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f1161b81-02a3-48de-a1c2-30c7fc8799c2 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:02.937780 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f1161b81-02a3-48de-a1c2-30c7fc8799c2 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:02.951287 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f1161b81-02a3-48de-a1c2-30c7fc8799c2 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1709 microversion: 2.1 time: 0.172638 Aug 18 14:54:02.952961 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 191/394] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:02 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1709 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:03.124116 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-5afabe69-56aa-44ec-a5a9-3ceb73616c4d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:03.124742 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-5afabe69-56aa-44ec-a5a9-3ceb73616c4d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:03.128282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f8c849b2-5b2f-43cd-abec-2acc158bc52a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:03.129282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f8c849b2-5b2f-43cd-abec-2acc158bc52a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:03.131872 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5afabe69-56aa-44ec-a5a9-3ceb73616c4d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:03.132636 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5afabe69-56aa-44ec-a5a9-3ceb73616c4d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:03.133336 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5afabe69-56aa-44ec-a5a9-3ceb73616c4d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:03.134517 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5afabe69-56aa-44ec-a5a9-3ceb73616c4d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:03.135168 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5afabe69-56aa-44ec-a5a9-3ceb73616c4d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:03.135817 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5afabe69-56aa-44ec-a5a9-3ceb73616c4d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:03.136273 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f8c849b2-5b2f-43cd-abec-2acc158bc52a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:03.136763 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f8c849b2-5b2f-43cd-abec-2acc158bc52a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:03.138174 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f8c849b2-5b2f-43cd-abec-2acc158bc52a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:03.139426 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f8c849b2-5b2f-43cd-abec-2acc158bc52a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:03.140425 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f8c849b2-5b2f-43cd-abec-2acc158bc52a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:03.140847 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f8c849b2-5b2f-43cd-abec-2acc158bc52a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:03.417980 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f8c849b2-5b2f-43cd-abec-2acc158bc52a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:03.426413 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-5afabe69-56aa-44ec-a5a9-3ceb73616c4d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:03.431593 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f8c849b2-5b2f-43cd-abec-2acc158bc52a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.307777 Aug 18 14:54:03.432739 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 192/395] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:03 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:03.434295 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-5afabe69-56aa-44ec-a5a9-3ceb73616c4d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1366 microversion: 2.1 time: 0.314914 Aug 18 14:54:03.440109 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 204/396] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:03 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1366 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:03.758233 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-1558a281-2973-4e75-b261-d4ce5dbc75cc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:03.760562 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-1558a281-2973-4e75-b261-d4ce5dbc75cc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:03.769912 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1558a281-2973-4e75-b261-d4ce5dbc75cc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:03.771407 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1558a281-2973-4e75-b261-d4ce5dbc75cc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:03.772303 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1558a281-2973-4e75-b261-d4ce5dbc75cc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:03.773364 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1558a281-2973-4e75-b261-d4ce5dbc75cc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:03.774763 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1558a281-2973-4e75-b261-d4ce5dbc75cc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:03.775615 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1558a281-2973-4e75-b261-d4ce5dbc75cc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:03.942334 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [req-7f84c571-4c45-4277-a1b7-166ccfe62075 req-f5ee33b7-dbd5-42ce-aac4-9e06782c15ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2b6fc4-0338-4141-9ac3-7b579718fae9", "name": "network-vif-plugged", "status": "completed", "tag": "54c7f937-7b5c-43bd-9d41-2e0484619d5f"}]} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:54:03.981696 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-7f84c571-4c45-4277-a1b7-166ccfe62075 req-f5ee33b7-dbd5-42ce-aac4-9e06782c15ed service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:03.982237 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-7f84c571-4c45-4277-a1b7-166ccfe62075 req-f5ee33b7-dbd5-42ce-aac4-9e06782c15ed service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:03.982685 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-7f84c571-4c45-4277-a1b7-166ccfe62075 req-f5ee33b7-dbd5-42ce-aac4-9e06782c15ed service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:04.023069 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-1558a281-2973-4e75-b261-d4ce5dbc75cc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:04.040487 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-1558a281-2973-4e75-b261-d4ce5dbc75cc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:04.042014 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-1558a281-2973-4e75-b261-d4ce5dbc75cc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:04.043228 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-1558a281-2973-4e75-b261-d4ce5dbc75cc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1744 microversion: 2.20 time: 0.295926 Aug 18 14:54:04.047845 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.compute.server_external_events [req-7f84c571-4c45-4277-a1b7-166ccfe62075 req-f5ee33b7-dbd5-42ce-aac4-9e06782c15ed service nova] Creating event network-vif-plugged:54c7f937-7b5c-43bd-9d41-2e0484619d5f for instance 3d2b6fc4-0338-4141-9ac3-7b579718fae9 on hv-cinder-85220 Aug 18 14:54:04.058744 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 193/397] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:03 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1744 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:04.062690 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [req-7f84c571-4c45-4277-a1b7-166ccfe62075 req-f5ee33b7-dbd5-42ce-aac4-9e06782c15ed service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127668 Aug 18 14:54:04.063298 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 205/398] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:54:04.081555 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-7d88f297-2b49-466f-9702-adbcac81f3c8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:04.082188 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-7d88f297-2b49-466f-9702-adbcac81f3c8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:04.093319 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:54:04.094870 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7d88f297-2b49-466f-9702-adbcac81f3c8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:04.104465 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7d88f297-2b49-466f-9702-adbcac81f3c8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:04.105255 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7d88f297-2b49-466f-9702-adbcac81f3c8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:04.106232 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7d88f297-2b49-466f-9702-adbcac81f3c8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:04.106913 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7d88f297-2b49-466f-9702-adbcac81f3c8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:04.107395 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7d88f297-2b49-466f-9702-adbcac81f3c8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:04.412075 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-7d88f297-2b49-466f-9702-adbcac81f3c8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:04.424094 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-7d88f297-2b49-466f-9702-adbcac81f3c8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1709 microversion: 2.1 time: 0.363909 Aug 18 14:54:04.427456 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 194/399] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:04 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1709 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:04.465584 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-deb4a6ca-d4eb-4bc4-8c01-ba8c15c33ef8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:04.466637 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-deb4a6ca-d4eb-4bc4-8c01-ba8c15c33ef8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:04.470284 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-671789de-eef2-41d9-98bd-3937a8cda112 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:04.471481 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-671789de-eef2-41d9-98bd-3937a8cda112 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:04.490883 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-deb4a6ca-d4eb-4bc4-8c01-ba8c15c33ef8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:04.494390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-deb4a6ca-d4eb-4bc4-8c01-ba8c15c33ef8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:04.495314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-deb4a6ca-d4eb-4bc4-8c01-ba8c15c33ef8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:04.496259 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-671789de-eef2-41d9-98bd-3937a8cda112 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:04.497683 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-deb4a6ca-d4eb-4bc4-8c01-ba8c15c33ef8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:04.498701 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-671789de-eef2-41d9-98bd-3937a8cda112 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:04.499955 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-deb4a6ca-d4eb-4bc4-8c01-ba8c15c33ef8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:04.500250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-671789de-eef2-41d9-98bd-3937a8cda112 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:04.501513 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-671789de-eef2-41d9-98bd-3937a8cda112 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:04.504545 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-671789de-eef2-41d9-98bd-3937a8cda112 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:04.505000 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-deb4a6ca-d4eb-4bc4-8c01-ba8c15c33ef8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:04.512408 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-671789de-eef2-41d9-98bd-3937a8cda112 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:04.846748 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-deb4a6ca-d4eb-4bc4-8c01-ba8c15c33ef8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:04.849573 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-671789de-eef2-41d9-98bd-3937a8cda112 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:04.855735 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-deb4a6ca-d4eb-4bc4-8c01-ba8c15c33ef8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.401673 Aug 18 14:54:04.856627 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 195/400] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:04 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:04.869002 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-671789de-eef2-41d9-98bd-3937a8cda112 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1366 microversion: 2.1 time: 0.417154 Aug 18 14:54:04.869796 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 206/401] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:04 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1366 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:54:05.083737 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-32909ffa-a3d3-4d5b-b326-4d028faffe1c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:05.084348 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-32909ffa-a3d3-4d5b-b326-4d028faffe1c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:05.091334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-32909ffa-a3d3-4d5b-b326-4d028faffe1c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:05.091863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-32909ffa-a3d3-4d5b-b326-4d028faffe1c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:05.092529 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-32909ffa-a3d3-4d5b-b326-4d028faffe1c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:05.093279 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-32909ffa-a3d3-4d5b-b326-4d028faffe1c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:05.093739 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-32909ffa-a3d3-4d5b-b326-4d028faffe1c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:05.094160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-32909ffa-a3d3-4d5b-b326-4d028faffe1c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:05.272856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-32909ffa-a3d3-4d5b-b326-4d028faffe1c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:05.282676 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-32909ffa-a3d3-4d5b-b326-4d028faffe1c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:05.284360 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-32909ffa-a3d3-4d5b-b326-4d028faffe1c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:05.285620 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-32909ffa-a3d3-4d5b-b326-4d028faffe1c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1744 microversion: 2.20 time: 0.205858 Aug 18 14:54:05.286335 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 196/402] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:05 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1744 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:05.456519 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-00960ea0-7e82-4f39-b48f-97eb66805cb7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:05.458203 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-00960ea0-7e82-4f39-b48f-97eb66805cb7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:05.466369 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-00960ea0-7e82-4f39-b48f-97eb66805cb7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:05.467228 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-00960ea0-7e82-4f39-b48f-97eb66805cb7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:05.468007 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-00960ea0-7e82-4f39-b48f-97eb66805cb7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:05.469026 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-00960ea0-7e82-4f39-b48f-97eb66805cb7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:05.469802 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-00960ea0-7e82-4f39-b48f-97eb66805cb7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:05.470494 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-00960ea0-7e82-4f39-b48f-97eb66805cb7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:05.635255 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-00960ea0-7e82-4f39-b48f-97eb66805cb7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:05.643959 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-00960ea0-7e82-4f39-b48f-97eb66805cb7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1709 microversion: 2.1 time: 0.191787 Aug 18 14:54:05.644546 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 207/403] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:05 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1709 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:05.877520 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b1dd7651-b148-4278-b31f-6772c5e0a5b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:05.878427 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b1dd7651-b148-4278-b31f-6772c5e0a5b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:05.889872 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-eb65e729-71ec-49cb-bf14-ad68bdb03ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:05.890496 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-eb65e729-71ec-49cb-bf14-ad68bdb03ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:05.897676 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-eb65e729-71ec-49cb-bf14-ad68bdb03ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:05.902607 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b1dd7651-b148-4278-b31f-6772c5e0a5b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:05.903542 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-eb65e729-71ec-49cb-bf14-ad68bdb03ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:05.904208 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-eb65e729-71ec-49cb-bf14-ad68bdb03ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:05.904962 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-eb65e729-71ec-49cb-bf14-ad68bdb03ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:05.905679 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b1dd7651-b148-4278-b31f-6772c5e0a5b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:05.906352 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-eb65e729-71ec-49cb-bf14-ad68bdb03ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:05.906992 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b1dd7651-b148-4278-b31f-6772c5e0a5b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:05.907609 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-eb65e729-71ec-49cb-bf14-ad68bdb03ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:05.908556 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b1dd7651-b148-4278-b31f-6772c5e0a5b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:05.911297 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b1dd7651-b148-4278-b31f-6772c5e0a5b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:05.911942 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b1dd7651-b148-4278-b31f-6772c5e0a5b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:06.226311 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b1dd7651-b148-4278-b31f-6772c5e0a5b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:06.236712 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b1dd7651-b148-4278-b31f-6772c5e0a5b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.363173 Aug 18 14:54:06.237549 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 197/404] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:05 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:06.243330 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-eb65e729-71ec-49cb-bf14-ad68bdb03ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:06.252915 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-eb65e729-71ec-49cb-bf14-ad68bdb03ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1366 microversion: 2.1 time: 0.366901 Aug 18 14:54:06.253625 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 208/405] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:05 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1366 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:06.315180 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-fa5cf9eb-5dd8-47d2-a688-ea14db56de0b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:06.315832 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-fa5cf9eb-5dd8-47d2-a688-ea14db56de0b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:06.321901 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fa5cf9eb-5dd8-47d2-a688-ea14db56de0b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:06.322396 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fa5cf9eb-5dd8-47d2-a688-ea14db56de0b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:06.322861 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fa5cf9eb-5dd8-47d2-a688-ea14db56de0b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:06.323564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fa5cf9eb-5dd8-47d2-a688-ea14db56de0b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:06.324049 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fa5cf9eb-5dd8-47d2-a688-ea14db56de0b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:06.324476 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fa5cf9eb-5dd8-47d2-a688-ea14db56de0b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:06.467265 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-fa5cf9eb-5dd8-47d2-a688-ea14db56de0b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:06.476489 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-fa5cf9eb-5dd8-47d2-a688-ea14db56de0b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:06.478654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-fa5cf9eb-5dd8-47d2-a688-ea14db56de0b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:06.479899 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-fa5cf9eb-5dd8-47d2-a688-ea14db56de0b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1739 microversion: 2.20 time: 0.169278 Aug 18 14:54:06.480460 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 198/406] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:06 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:06.667537 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-2ac26efa-2949-48bb-95bc-adace19c1ac0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:06.668241 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-2ac26efa-2949-48bb-95bc-adace19c1ac0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:06.676105 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2ac26efa-2949-48bb-95bc-adace19c1ac0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:06.676602 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2ac26efa-2949-48bb-95bc-adace19c1ac0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:06.677039 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2ac26efa-2949-48bb-95bc-adace19c1ac0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:06.677752 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2ac26efa-2949-48bb-95bc-adace19c1ac0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:06.678217 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2ac26efa-2949-48bb-95bc-adace19c1ac0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:06.678844 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2ac26efa-2949-48bb-95bc-adace19c1ac0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:06.847580 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-2ac26efa-2949-48bb-95bc-adace19c1ac0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:06.856762 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-2ac26efa-2949-48bb-95bc-adace19c1ac0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1709 microversion: 2.1 time: 0.193517 Aug 18 14:54:06.857691 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 209/407] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:06 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1709 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:07.262050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f0bba474-1856-4eba-bb0f-b81c605f6c2e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:07.262050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f0bba474-1856-4eba-bb0f-b81c605f6c2e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:07.274053 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-5a88b8cd-88d3-4f8d-9657-f8a2e65ff71b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:07.274357 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f0bba474-1856-4eba-bb0f-b81c605f6c2e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:07.274683 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-5a88b8cd-88d3-4f8d-9657-f8a2e65ff71b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:07.274851 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f0bba474-1856-4eba-bb0f-b81c605f6c2e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:07.275292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f0bba474-1856-4eba-bb0f-b81c605f6c2e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:07.276135 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f0bba474-1856-4eba-bb0f-b81c605f6c2e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:07.277103 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f0bba474-1856-4eba-bb0f-b81c605f6c2e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:07.278137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f0bba474-1856-4eba-bb0f-b81c605f6c2e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:07.283318 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5a88b8cd-88d3-4f8d-9657-f8a2e65ff71b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:07.284256 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5a88b8cd-88d3-4f8d-9657-f8a2e65ff71b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:07.284886 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5a88b8cd-88d3-4f8d-9657-f8a2e65ff71b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:07.285894 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5a88b8cd-88d3-4f8d-9657-f8a2e65ff71b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:07.286814 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5a88b8cd-88d3-4f8d-9657-f8a2e65ff71b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:07.287243 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5a88b8cd-88d3-4f8d-9657-f8a2e65ff71b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:07.544063 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f0bba474-1856-4eba-bb0f-b81c605f6c2e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:07.552220 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f0bba474-1856-4eba-bb0f-b81c605f6c2e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.297212 Aug 18 14:54:07.552799 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 199/408] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:07 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:07.557909 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-74fdea1f-5376-4237-8c9f-b05b70e337fb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:07.558523 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-74fdea1f-5376-4237-8c9f-b05b70e337fb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:07.559850 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-5a88b8cd-88d3-4f8d-9657-f8a2e65ff71b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:07.565306 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74fdea1f-5376-4237-8c9f-b05b70e337fb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:07.565809 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74fdea1f-5376-4237-8c9f-b05b70e337fb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:07.566247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74fdea1f-5376-4237-8c9f-b05b70e337fb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:07.566955 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74fdea1f-5376-4237-8c9f-b05b70e337fb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:07.567412 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74fdea1f-5376-4237-8c9f-b05b70e337fb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:07.567909 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74fdea1f-5376-4237-8c9f-b05b70e337fb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:07.568238 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-5a88b8cd-88d3-4f8d-9657-f8a2e65ff71b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1366 microversion: 2.1 time: 0.298057 Aug 18 14:54:07.568853 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 210/409] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:07 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:07.708069 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-74fdea1f-5376-4237-8c9f-b05b70e337fb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:07.716794 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-74fdea1f-5376-4237-8c9f-b05b70e337fb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:07.718278 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-74fdea1f-5376-4237-8c9f-b05b70e337fb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:07.719429 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-74fdea1f-5376-4237-8c9f-b05b70e337fb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1739 microversion: 2.20 time: 0.165719 Aug 18 14:54:07.720007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 200/410] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:07 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:07.888922 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-f2d82880-7dae-4a11-9994-576a4502552f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:07.889529 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-f2d82880-7dae-4a11-9994-576a4502552f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:07.896099 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f2d82880-7dae-4a11-9994-576a4502552f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:07.896754 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f2d82880-7dae-4a11-9994-576a4502552f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:07.897020 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f2d82880-7dae-4a11-9994-576a4502552f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:07.897722 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f2d82880-7dae-4a11-9994-576a4502552f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:07.898170 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f2d82880-7dae-4a11-9994-576a4502552f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:07.898592 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-f2d82880-7dae-4a11-9994-576a4502552f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:08.035926 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-f2d82880-7dae-4a11-9994-576a4502552f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:08.045135 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-f2d82880-7dae-4a11-9994-576a4502552f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1713 microversion: 2.1 time: 0.160336 Aug 18 14:54:08.045716 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 211/411] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:07 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1713 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:08.573462 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d87fa158-82f8-4319-bcf0-e259d0c10960 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:08.574073 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d87fa158-82f8-4319-bcf0-e259d0c10960 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:08.580579 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d87fa158-82f8-4319-bcf0-e259d0c10960 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:08.581083 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d87fa158-82f8-4319-bcf0-e259d0c10960 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:08.581516 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d87fa158-82f8-4319-bcf0-e259d0c10960 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:08.582207 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d87fa158-82f8-4319-bcf0-e259d0c10960 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:08.582658 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d87fa158-82f8-4319-bcf0-e259d0c10960 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:08.583078 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d87fa158-82f8-4319-bcf0-e259d0c10960 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:08.590686 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-3d9ce8ed-6a89-455f-8a23-7abcaf9ddd1f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:08.591297 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-3d9ce8ed-6a89-455f-8a23-7abcaf9ddd1f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:08.598992 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-3d9ce8ed-6a89-455f-8a23-7abcaf9ddd1f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:08.599476 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-3d9ce8ed-6a89-455f-8a23-7abcaf9ddd1f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:08.600073 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-3d9ce8ed-6a89-455f-8a23-7abcaf9ddd1f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:08.600778 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-3d9ce8ed-6a89-455f-8a23-7abcaf9ddd1f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:08.601230 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-3d9ce8ed-6a89-455f-8a23-7abcaf9ddd1f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:08.601647 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-3d9ce8ed-6a89-455f-8a23-7abcaf9ddd1f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:08.782885 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d87fa158-82f8-4319-bcf0-e259d0c10960 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:08.790039 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-3d9ce8ed-6a89-455f-8a23-7abcaf9ddd1f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:08.791072 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d87fa158-82f8-4319-bcf0-e259d0c10960 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.222087 Aug 18 14:54:08.791745 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 201/412] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:08 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:08.796352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-084c2667-bc5a-4e2d-93d2-2d158ee664fe tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:08.797038 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-084c2667-bc5a-4e2d-93d2-2d158ee664fe tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:08.798046 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-3d9ce8ed-6a89-455f-8a23-7abcaf9ddd1f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1366 microversion: 2.1 time: 0.211754 Aug 18 14:54:08.798817 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 212/413] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:08 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:54:08.803204 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-084c2667-bc5a-4e2d-93d2-2d158ee664fe tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:08.803800 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-084c2667-bc5a-4e2d-93d2-2d158ee664fe tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:08.804306 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-084c2667-bc5a-4e2d-93d2-2d158ee664fe tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:08.805506 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-084c2667-bc5a-4e2d-93d2-2d158ee664fe tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:08.805956 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-084c2667-bc5a-4e2d-93d2-2d158ee664fe tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:08.806375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-084c2667-bc5a-4e2d-93d2-2d158ee664fe tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:08.952261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-084c2667-bc5a-4e2d-93d2-2d158ee664fe tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:08.960730 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-084c2667-bc5a-4e2d-93d2-2d158ee664fe tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:08.962222 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-084c2667-bc5a-4e2d-93d2-2d158ee664fe tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:08.963397 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-084c2667-bc5a-4e2d-93d2-2d158ee664fe tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1739 microversion: 2.20 time: 0.170660 Aug 18 14:54:08.963993 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 202/414] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:08 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:09.812033 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-c49c12a1-9e1d-4bdf-8835-5422ba9f53c0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:09.812645 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-c49c12a1-9e1d-4bdf-8835-5422ba9f53c0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:09.818957 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c49c12a1-9e1d-4bdf-8835-5422ba9f53c0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:09.819470 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c49c12a1-9e1d-4bdf-8835-5422ba9f53c0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:09.819815 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8b0b81fd-a41d-45f0-887f-8cc0d0236fc9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:09.822756 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c49c12a1-9e1d-4bdf-8835-5422ba9f53c0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:09.822943 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-8b0b81fd-a41d-45f0-887f-8cc0d0236fc9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:09.823104 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c49c12a1-9e1d-4bdf-8835-5422ba9f53c0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:09.823104 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c49c12a1-9e1d-4bdf-8835-5422ba9f53c0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:09.823104 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c49c12a1-9e1d-4bdf-8835-5422ba9f53c0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:09.828113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b0b81fd-a41d-45f0-887f-8cc0d0236fc9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:09.828598 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b0b81fd-a41d-45f0-887f-8cc0d0236fc9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:09.829044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b0b81fd-a41d-45f0-887f-8cc0d0236fc9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:09.829722 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b0b81fd-a41d-45f0-887f-8cc0d0236fc9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:09.830169 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b0b81fd-a41d-45f0-887f-8cc0d0236fc9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:09.830581 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b0b81fd-a41d-45f0-887f-8cc0d0236fc9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:10.026243 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-c49c12a1-9e1d-4bdf-8835-5422ba9f53c0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:10.028801 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8b0b81fd-a41d-45f0-887f-8cc0d0236fc9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:10.040282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-8b0b81fd-a41d-45f0-887f-8cc0d0236fc9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1366 microversion: 2.1 time: 0.224015 Aug 18 14:54:10.040968 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 203/415] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:09 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:54:10.052672 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a85c9012-98e8-4060-8384-5e16dd5dbf6d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:10.055400 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a85c9012-98e8-4060-8384-5e16dd5dbf6d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:10.067768 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a85c9012-98e8-4060-8384-5e16dd5dbf6d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:10.068803 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a85c9012-98e8-4060-8384-5e16dd5dbf6d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:10.069597 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a85c9012-98e8-4060-8384-5e16dd5dbf6d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:10.071381 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a85c9012-98e8-4060-8384-5e16dd5dbf6d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:10.072579 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a85c9012-98e8-4060-8384-5e16dd5dbf6d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:10.073783 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-c49c12a1-9e1d-4bdf-8835-5422ba9f53c0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.265627 Aug 18 14:54:10.074690 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a85c9012-98e8-4060-8384-5e16dd5dbf6d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:10.077228 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 213/416] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:09 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:10.308134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a85c9012-98e8-4060-8384-5e16dd5dbf6d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:10.323073 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a85c9012-98e8-4060-8384-5e16dd5dbf6d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:10.325044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a85c9012-98e8-4060-8384-5e16dd5dbf6d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:10.326496 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a85c9012-98e8-4060-8384-5e16dd5dbf6d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1739 microversion: 2.20 time: 0.282317 Aug 18 14:54:10.327714 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 204/417] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:10 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1739 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:11.069650 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-82259cf2-01bd-4f3e-9b45-55ca999d14ea tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:11.071491 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-82259cf2-01bd-4f3e-9b45-55ca999d14ea tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:11.080150 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-82259cf2-01bd-4f3e-9b45-55ca999d14ea tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:11.081126 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-82259cf2-01bd-4f3e-9b45-55ca999d14ea tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:11.087788 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-82259cf2-01bd-4f3e-9b45-55ca999d14ea tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:11.096137 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-82259cf2-01bd-4f3e-9b45-55ca999d14ea tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:11.098935 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-4eb052d2-1341-46cd-ab00-f1ec2290bbf2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:11.100079 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-82259cf2-01bd-4f3e-9b45-55ca999d14ea tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:11.100375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-4eb052d2-1341-46cd-ab00-f1ec2290bbf2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:11.100732 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-82259cf2-01bd-4f3e-9b45-55ca999d14ea tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:11.108372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4eb052d2-1341-46cd-ab00-f1ec2290bbf2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:11.109165 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4eb052d2-1341-46cd-ab00-f1ec2290bbf2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:11.109826 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4eb052d2-1341-46cd-ab00-f1ec2290bbf2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:11.110893 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4eb052d2-1341-46cd-ab00-f1ec2290bbf2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:11.111704 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4eb052d2-1341-46cd-ab00-f1ec2290bbf2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:11.112664 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4eb052d2-1341-46cd-ab00-f1ec2290bbf2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:11.139348 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:54:11.674421 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-4eb052d2-1341-46cd-ab00-f1ec2290bbf2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:11.689444 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-4eb052d2-1341-46cd-ab00-f1ec2290bbf2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.594756 Aug 18 14:54:11.706354 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 205/418] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:11 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:54:11.719315 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c450705f-2ada-45b1-916b-2cae1675b371 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:11.720476 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c450705f-2ada-45b1-916b-2cae1675b371 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:11.734259 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c450705f-2ada-45b1-916b-2cae1675b371 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:11.735631 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c450705f-2ada-45b1-916b-2cae1675b371 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:11.736464 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c450705f-2ada-45b1-916b-2cae1675b371 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:11.736726 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-82259cf2-01bd-4f3e-9b45-55ca999d14ea tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:11.737547 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c450705f-2ada-45b1-916b-2cae1675b371 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:11.738278 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c450705f-2ada-45b1-916b-2cae1675b371 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:11.738926 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c450705f-2ada-45b1-916b-2cae1675b371 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:11.768482 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-82259cf2-01bd-4f3e-9b45-55ca999d14ea tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1366 microversion: 2.1 time: 0.700105 Aug 18 14:54:11.773634 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 214/419] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:11 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1366 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:11.791460 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [req-8b209541-236e-4ebc-998a-c6673bbba3b3 req-ee233e0d-9cf1-43d1-bd7f-d8630b61a7c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa15c998-af91-4654-9cf6-ee7b4b1da164", "name": "network-vif-plugged", "status": "completed", "tag": "c53b5061-6ea7-41b4-b0ac-30785ff1f9b9"}]} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:54:11.854010 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-8b209541-236e-4ebc-998a-c6673bbba3b3 req-ee233e0d-9cf1-43d1-bd7f-d8630b61a7c1 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:11.854709 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-8b209541-236e-4ebc-998a-c6673bbba3b3 req-ee233e0d-9cf1-43d1-bd7f-d8630b61a7c1 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:11.855303 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-8b209541-236e-4ebc-998a-c6673bbba3b3 req-ee233e0d-9cf1-43d1-bd7f-d8630b61a7c1 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:11.873719 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.compute.server_external_events [req-8b209541-236e-4ebc-998a-c6673bbba3b3 req-ee233e0d-9cf1-43d1-bd7f-d8630b61a7c1 service nova] Creating event network-vif-plugged:c53b5061-6ea7-41b4-b0ac-30785ff1f9b9 for instance aa15c998-af91-4654-9cf6-ee7b4b1da164 on hv-cinder-85220 Aug 18 14:54:11.883212 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [req-8b209541-236e-4ebc-998a-c6673bbba3b3 req-ee233e0d-9cf1-43d1-bd7f-d8630b61a7c1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107299 Aug 18 14:54:11.886953 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 215/420] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:54:11.941814 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-9e4ba37d-3293-421e-9101-593b67f3ca31 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1847075065", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-198073082", "security_groups": [{"name": "tempest-secgroup-smoke-456689280"}], "block_device_mapping_v2": [{"uuid": "3d258111-6c50-45c5-8367-8cc6883b6ba4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "24aebd51-9a3b-4fcd-801c-0a194132131f"}]}} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:54:12.087169 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c450705f-2ada-45b1-916b-2cae1675b371 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:12.102277 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c450705f-2ada-45b1-916b-2cae1675b371 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:12.105736 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c450705f-2ada-45b1-916b-2cae1675b371 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:12.111771 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c450705f-2ada-45b1-916b-2cae1675b371 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1739 microversion: 2.20 time: 0.400304 Aug 18 14:54:12.112645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 206/421] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:11 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1739 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:12.265829 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.network.neutron [None req-9e4ba37d-3293-421e-9101-593b67f3ca31 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] validate_networks() for [('24aebd51-9a3b-4fcd-801c-0a194132131f', None, None, None, None, None)] {{(pid=132267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:54:12.717215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-655ea992-7b3b-4aa3-8428-2cb2cb6ba474 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:12.717720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-655ea992-7b3b-4aa3-8428-2cb2cb6ba474 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:12.728235 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-655ea992-7b3b-4aa3-8428-2cb2cb6ba474 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:12.739642 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-655ea992-7b3b-4aa3-8428-2cb2cb6ba474 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:12.740373 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-655ea992-7b3b-4aa3-8428-2cb2cb6ba474 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:12.741275 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-655ea992-7b3b-4aa3-8428-2cb2cb6ba474 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:12.741883 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-655ea992-7b3b-4aa3-8428-2cb2cb6ba474 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:12.742585 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-655ea992-7b3b-4aa3-8428-2cb2cb6ba474 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:12.824225 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=100 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:54:13.651633 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-655ea992-7b3b-4aa3-8428-2cb2cb6ba474 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:13.662293 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-655ea992-7b3b-4aa3-8428-2cb2cb6ba474 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.949117 Aug 18 14:54:13.665565 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 207/422] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:12 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:54:13.671574 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-bc0ef4e6-315e-4632-bb2e-d100dc72d499 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:13.672634 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-bc0ef4e6-315e-4632-bb2e-d100dc72d499 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:13.688774 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bc0ef4e6-315e-4632-bb2e-d100dc72d499 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:13.691769 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bc0ef4e6-315e-4632-bb2e-d100dc72d499 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:13.694499 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bc0ef4e6-315e-4632-bb2e-d100dc72d499 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:13.696696 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bc0ef4e6-315e-4632-bb2e-d100dc72d499 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:13.698893 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bc0ef4e6-315e-4632-bb2e-d100dc72d499 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:13.699708 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bc0ef4e6-315e-4632-bb2e-d100dc72d499 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:13.767528 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.virt.hardware [None req-9e4ba37d-3293-421e-9101-593b67f3ca31 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Flavor limits 0:0:0 {{(pid=132267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:54:13.768171 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.virt.hardware [None req-9e4ba37d-3293-421e-9101-593b67f3ca31 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Image limits 0:0:0 {{(pid=132267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:54:13.768694 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.virt.hardware [None req-9e4ba37d-3293-421e-9101-593b67f3ca31 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Flavor pref 0:0:0 {{(pid=132267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:54:13.769101 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.virt.hardware [None req-9e4ba37d-3293-421e-9101-593b67f3ca31 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Image pref 0:0:0 {{(pid=132267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:54:13.769515 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.virt.hardware [None req-9e4ba37d-3293-421e-9101-593b67f3ca31 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:54:13.809872 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9e4ba37d-3293-421e-9101-593b67f3ca31 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:13.810378 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9e4ba37d-3293-421e-9101-593b67f3ca31 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:13.810818 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9e4ba37d-3293-421e-9101-593b67f3ca31 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:13.811565 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9e4ba37d-3293-421e-9101-593b67f3ca31 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:13.812083 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9e4ba37d-3293-421e-9101-593b67f3ca31 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:13.812512 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-9e4ba37d-3293-421e-9101-593b67f3ca31 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:13.867085 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.quota [None req-9e4ba37d-3293-421e-9101-593b67f3ca31 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Getting quotas for project d334ad6bd6194604a61ce4ca95149993. Resources: {'ram', 'instances', 'cores'} {{(pid=132267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:54:13.879374 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.quota [None req-9e4ba37d-3293-421e-9101-593b67f3ca31 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Getting quotas for user ac4d918f549c41d3ae19e80cecefa95c and project d334ad6bd6194604a61ce4ca95149993. Resources: {'ram', 'instances', 'cores'} {{(pid=132267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:54:14.060657 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-bc0ef4e6-315e-4632-bb2e-d100dc72d499 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:14.083244 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-bc0ef4e6-315e-4632-bb2e-d100dc72d499 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1366 microversion: 2.1 time: 0.412141 Aug 18 14:54:14.096024 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-9e4ba37d-3293-421e-9101-593b67f3ca31 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Going to run 1 instances... {{(pid=132267) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:54:14.096024 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-9e4ba37d-3293-421e-9101-593b67f3ca31 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3d258111-6c50-45c5-8367-8cc6883b6ba4',volume_size=None,volume_type=None)] {{(pid=132267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:54:14.102899 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 208/423] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:13 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1366 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:14.110885 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-80b76c98-0941-49cd-8694-bd25c746386a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:14.113580 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-80b76c98-0941-49cd-8694-bd25c746386a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:14.124635 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-80b76c98-0941-49cd-8694-bd25c746386a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:14.125601 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-80b76c98-0941-49cd-8694-bd25c746386a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:14.126299 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-80b76c98-0941-49cd-8694-bd25c746386a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:14.127471 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-80b76c98-0941-49cd-8694-bd25c746386a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:14.128940 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-80b76c98-0941-49cd-8694-bd25c746386a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:14.129869 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-80b76c98-0941-49cd-8694-bd25c746386a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:14.412792 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-80b76c98-0941-49cd-8694-bd25c746386a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:14.433348 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-80b76c98-0941-49cd-8694-bd25c746386a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:14.437164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-80b76c98-0941-49cd-8694-bd25c746386a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:14.438842 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-80b76c98-0941-49cd-8694-bd25c746386a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1739 microversion: 2.20 time: 0.333893 Aug 18 14:54:14.440986 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-9e4ba37d-3293-421e-9101-593b67f3ca31 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.530321 Aug 18 14:54:14.442131 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 216/425] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Aug 18 14:54:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 2533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:54:14.442403 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 209/425] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:14 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1739 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:14.471715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d2406c85-77fb-4a65-9705-b385aaff7353 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:14.472476 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d2406c85-77fb-4a65-9705-b385aaff7353 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:14.698190 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-81668053-88b0-4420-bab6-ebd194cf9734 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:14.699015 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-81668053-88b0-4420-bab6-ebd194cf9734 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:14.710744 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d2406c85-77fb-4a65-9705-b385aaff7353 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:14.719276 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-81668053-88b0-4420-bab6-ebd194cf9734 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:14.722222 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-81668053-88b0-4420-bab6-ebd194cf9734 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:14.724037 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-81668053-88b0-4420-bab6-ebd194cf9734 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:14.730091 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-81668053-88b0-4420-bab6-ebd194cf9734 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:14.732270 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d2406c85-77fb-4a65-9705-b385aaff7353 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 200 len: 1094 microversion: 2.1 time: 0.261460 Aug 18 14:54:14.732887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 210/426] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:14 2022] GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 1094 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:14.733278 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-81668053-88b0-4420-bab6-ebd194cf9734 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:14.734064 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-81668053-88b0-4420-bab6-ebd194cf9734 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:15.059290 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-81668053-88b0-4420-bab6-ebd194cf9734 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:15.073730 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-81668053-88b0-4420-bab6-ebd194cf9734 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.382035 Aug 18 14:54:15.074832 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 217/427] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:14 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:54:15.118556 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-383ab941-9063-40b3-ba1f-517bb326b41e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:15.119483 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-383ab941-9063-40b3-ba1f-517bb326b41e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:15.150220 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-383ab941-9063-40b3-ba1f-517bb326b41e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:15.152134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-383ab941-9063-40b3-ba1f-517bb326b41e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:15.154721 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-383ab941-9063-40b3-ba1f-517bb326b41e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:15.155544 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-383ab941-9063-40b3-ba1f-517bb326b41e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:15.156131 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-383ab941-9063-40b3-ba1f-517bb326b41e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:15.156596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-383ab941-9063-40b3-ba1f-517bb326b41e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:15.460199 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-383ab941-9063-40b3-ba1f-517bb326b41e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:15.479576 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-383ab941-9063-40b3-ba1f-517bb326b41e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1556 microversion: 2.1 time: 0.365104 Aug 18 14:54:15.480201 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 211/428] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:15 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1556 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:54:15.500402 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-4e111862-3ff6-4887-9b31-c1dc6e0c6792 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:15.501395 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-4e111862-3ff6-4887-9b31-c1dc6e0c6792 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:15.516000 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4e111862-3ff6-4887-9b31-c1dc6e0c6792 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:15.517862 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4e111862-3ff6-4887-9b31-c1dc6e0c6792 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:15.518596 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4e111862-3ff6-4887-9b31-c1dc6e0c6792 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:15.519733 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4e111862-3ff6-4887-9b31-c1dc6e0c6792 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:15.520851 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4e111862-3ff6-4887-9b31-c1dc6e0c6792 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:15.521505 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4e111862-3ff6-4887-9b31-c1dc6e0c6792 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:15.525723 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-30c9eb39-2f8d-4c87-8258-1bb79f79e8c4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:15.526467 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-30c9eb39-2f8d-4c87-8258-1bb79f79e8c4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:15.540225 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-30c9eb39-2f8d-4c87-8258-1bb79f79e8c4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:15.541806 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-30c9eb39-2f8d-4c87-8258-1bb79f79e8c4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:15.542823 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-30c9eb39-2f8d-4c87-8258-1bb79f79e8c4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:15.545358 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-30c9eb39-2f8d-4c87-8258-1bb79f79e8c4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:15.546952 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-30c9eb39-2f8d-4c87-8258-1bb79f79e8c4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:15.548267 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-30c9eb39-2f8d-4c87-8258-1bb79f79e8c4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:15.768118 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-30c9eb39-2f8d-4c87-8258-1bb79f79e8c4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.246243 Aug 18 14:54:15.790230 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 212/429] 10.222.0.36 () {58 vars in 1275 bytes} [Thu Aug 18 14:54:15 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164/os-interface => generated 284 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:54:15.800425 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-fe0375dd-417b-4b8a-a898-b965ca7b689d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:15.805701 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-fe0375dd-417b-4b8a-a898-b965ca7b689d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:15.822768 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fe0375dd-417b-4b8a-a898-b965ca7b689d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:15.823833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fe0375dd-417b-4b8a-a898-b965ca7b689d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:15.825896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fe0375dd-417b-4b8a-a898-b965ca7b689d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:15.829311 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fe0375dd-417b-4b8a-a898-b965ca7b689d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:15.830874 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fe0375dd-417b-4b8a-a898-b965ca7b689d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:15.833379 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fe0375dd-417b-4b8a-a898-b965ca7b689d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:15.968804 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-4e111862-3ff6-4887-9b31-c1dc6e0c6792 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:15.986423 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-4e111862-3ff6-4887-9b31-c1dc6e0c6792 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:15.995577 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-4e111862-3ff6-4887-9b31-c1dc6e0c6792 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:15.997904 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-4e111862-3ff6-4887-9b31-c1dc6e0c6792 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1739 microversion: 2.20 time: 0.502609 Aug 18 14:54:16.025445 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 218/430] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:15 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1739 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:16.059544 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-fe0375dd-417b-4b8a-a898-b965ca7b689d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:16.089444 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-fe0375dd-417b-4b8a-a898-b965ca7b689d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 200 len: 1136 microversion: 2.1 time: 0.295230 Aug 18 14:54:16.099708 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 213/431] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:15 2022] GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 1136 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:16.109539 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-c908df55-aa38-4fae-8667-dbab2fb3dfe4 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:16.111158 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-c908df55-aa38-4fae-8667-dbab2fb3dfe4 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:16.127378 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c908df55-aa38-4fae-8667-dbab2fb3dfe4 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:16.132897 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c908df55-aa38-4fae-8667-dbab2fb3dfe4 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:16.134106 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c908df55-aa38-4fae-8667-dbab2fb3dfe4 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:16.135162 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c908df55-aa38-4fae-8667-dbab2fb3dfe4 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:16.143030 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c908df55-aa38-4fae-8667-dbab2fb3dfe4 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:16.144140 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c908df55-aa38-4fae-8667-dbab2fb3dfe4 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:16.367417 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-c908df55-aa38-4fae-8667-dbab2fb3dfe4 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:16.386854 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-c908df55-aa38-4fae-8667-dbab2fb3dfe4 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.279210 Aug 18 14:54:16.388099 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 219/432] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:16 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:17.024152 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-17f50223-1f9d-4ce5-a55a-b683cf8e2268 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:17.025545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-17f50223-1f9d-4ce5-a55a-b683cf8e2268 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:17.036681 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-17f50223-1f9d-4ce5-a55a-b683cf8e2268 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:17.040125 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-17f50223-1f9d-4ce5-a55a-b683cf8e2268 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:17.043756 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-17f50223-1f9d-4ce5-a55a-b683cf8e2268 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:17.044884 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-17f50223-1f9d-4ce5-a55a-b683cf8e2268 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:17.045630 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-17f50223-1f9d-4ce5-a55a-b683cf8e2268 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:17.048449 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-17f50223-1f9d-4ce5-a55a-b683cf8e2268 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:17.118291 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-7d9b9b70-3a27-4626-accc-2217c5f31331 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:17.122410 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-7d9b9b70-3a27-4626-accc-2217c5f31331 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:17.151296 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7d9b9b70-3a27-4626-accc-2217c5f31331 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:17.158386 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7d9b9b70-3a27-4626-accc-2217c5f31331 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:17.163114 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7d9b9b70-3a27-4626-accc-2217c5f31331 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:17.165410 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7d9b9b70-3a27-4626-accc-2217c5f31331 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:17.166568 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7d9b9b70-3a27-4626-accc-2217c5f31331 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:17.171276 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7d9b9b70-3a27-4626-accc-2217c5f31331 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:17.566015 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-7d9b9b70-3a27-4626-accc-2217c5f31331 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:17.595046 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-7d9b9b70-3a27-4626-accc-2217c5f31331 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 200 len: 1210 microversion: 2.1 time: 0.481124 Aug 18 14:54:17.597942 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 220/433] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:17 2022] GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 1210 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:17.615521 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-4be97150-f316-4e0c-9e8b-2cab900a8d78 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:17.618472 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-4be97150-f316-4e0c-9e8b-2cab900a8d78 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:17.641166 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4be97150-f316-4e0c-9e8b-2cab900a8d78 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:17.644917 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4be97150-f316-4e0c-9e8b-2cab900a8d78 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:17.646406 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4be97150-f316-4e0c-9e8b-2cab900a8d78 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:17.650429 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4be97150-f316-4e0c-9e8b-2cab900a8d78 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:17.652042 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4be97150-f316-4e0c-9e8b-2cab900a8d78 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:17.657809 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4be97150-f316-4e0c-9e8b-2cab900a8d78 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:17.824889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-17f50223-1f9d-4ce5-a55a-b683cf8e2268 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:17.838125 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-17f50223-1f9d-4ce5-a55a-b683cf8e2268 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:17.841464 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-17f50223-1f9d-4ce5-a55a-b683cf8e2268 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:17.846417 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-17f50223-1f9d-4ce5-a55a-b683cf8e2268 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1739 microversion: 2.20 time: 0.826507 Aug 18 14:54:17.849143 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 214/434] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:17 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1739 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:18.061232 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-7952928b-8be2-468e-a2d1-bc9649285426 req-22419c51-faa4-4952-9991-28e2a2b71339 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa15c998-af91-4654-9cf6-ee7b4b1da164", "tag": "c53b5061-6ea7-41b4-b0ac-30785ff1f9b9"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:54:18.135888 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-7952928b-8be2-468e-a2d1-bc9649285426 req-22419c51-faa4-4952-9991-28e2a2b71339 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:18.139435 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-7952928b-8be2-468e-a2d1-bc9649285426 req-22419c51-faa4-4952-9991-28e2a2b71339 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:18.145207 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-7952928b-8be2-468e-a2d1-bc9649285426 req-22419c51-faa4-4952-9991-28e2a2b71339 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:18.225330 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-7952928b-8be2-468e-a2d1-bc9649285426 req-22419c51-faa4-4952-9991-28e2a2b71339 service nova] Creating event network-changed:c53b5061-6ea7-41b4-b0ac-30785ff1f9b9 for instance aa15c998-af91-4654-9cf6-ee7b4b1da164 on hv-cinder-85220 Aug 18 14:54:18.248926 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-7952928b-8be2-468e-a2d1-bc9649285426 req-22419c51-faa4-4952-9991-28e2a2b71339 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195723 Aug 18 14:54:18.260105 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 215/435] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:54:18.624619 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e1a2ac6c-176e-4be8-8317-d19c569a95a0 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:18.625696 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e1a2ac6c-176e-4be8-8317-d19c569a95a0 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:18.644001 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e1a2ac6c-176e-4be8-8317-d19c569a95a0 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:18.647343 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e1a2ac6c-176e-4be8-8317-d19c569a95a0 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:18.651454 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e1a2ac6c-176e-4be8-8317-d19c569a95a0 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:18.653600 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e1a2ac6c-176e-4be8-8317-d19c569a95a0 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:18.655472 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e1a2ac6c-176e-4be8-8317-d19c569a95a0 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:18.657133 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e1a2ac6c-176e-4be8-8317-d19c569a95a0 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:18.679348 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-4be97150-f316-4e0c-9e8b-2cab900a8d78 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:18.693299 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-4be97150-f316-4e0c-9e8b-2cab900a8d78 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 1.090026 Aug 18 14:54:18.697407 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 221/436] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:17 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:18.874801 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-7103b915-ad70-4611-9815-d4057696e6cb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:18.876779 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-7103b915-ad70-4611-9815-d4057696e6cb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:18.905027 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7103b915-ad70-4611-9815-d4057696e6cb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:18.905998 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7103b915-ad70-4611-9815-d4057696e6cb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:18.907050 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7103b915-ad70-4611-9815-d4057696e6cb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:18.908269 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7103b915-ad70-4611-9815-d4057696e6cb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:18.911230 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7103b915-ad70-4611-9815-d4057696e6cb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:18.911906 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-7103b915-ad70-4611-9815-d4057696e6cb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:18.998664 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e1a2ac6c-176e-4be8-8317-d19c569a95a0 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:19.011378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e1a2ac6c-176e-4be8-8317-d19c569a95a0 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 200 len: 1198 microversion: 2.1 time: 0.394743 Aug 18 14:54:19.029382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 216/437] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:18 2022] GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 1198 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:19.450057 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-7103b915-ad70-4611-9815-d4057696e6cb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:19.475420 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-7103b915-ad70-4611-9815-d4057696e6cb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:19.477748 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-7103b915-ad70-4611-9815-d4057696e6cb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:19.479907 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-7103b915-ad70-4611-9815-d4057696e6cb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1739 microversion: 2.20 time: 0.609235 Aug 18 14:54:19.481511 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 222/438] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:18 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1739 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:19.720624 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-81a22adf-1d63-4271-be5b-71f3cad2ea59 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:19.721994 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-81a22adf-1d63-4271-be5b-71f3cad2ea59 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:19.737701 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-81a22adf-1d63-4271-be5b-71f3cad2ea59 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:19.739707 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-81a22adf-1d63-4271-be5b-71f3cad2ea59 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:19.740395 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-81a22adf-1d63-4271-be5b-71f3cad2ea59 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:19.742260 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-81a22adf-1d63-4271-be5b-71f3cad2ea59 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:19.742973 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-81a22adf-1d63-4271-be5b-71f3cad2ea59 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:19.743616 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-81a22adf-1d63-4271-be5b-71f3cad2ea59 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:20.041290 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-ef2a60e1-2f42-4ad6-a61a-53a496a51675 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:20.042729 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-ef2a60e1-2f42-4ad6-a61a-53a496a51675 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:20.053742 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ef2a60e1-2f42-4ad6-a61a-53a496a51675 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:20.057950 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ef2a60e1-2f42-4ad6-a61a-53a496a51675 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:20.060121 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ef2a60e1-2f42-4ad6-a61a-53a496a51675 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:20.063417 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ef2a60e1-2f42-4ad6-a61a-53a496a51675 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:20.064385 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ef2a60e1-2f42-4ad6-a61a-53a496a51675 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:20.065054 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ef2a60e1-2f42-4ad6-a61a-53a496a51675 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:20.686289 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-81a22adf-1d63-4271-be5b-71f3cad2ea59 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:20.696560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-81a22adf-1d63-4271-be5b-71f3cad2ea59 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.981989 Aug 18 14:54:20.699750 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 217/439] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:19 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:20.716057 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d00bfa65-95d5-490f-8406-a7e18778ea6e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:20.716655 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d00bfa65-95d5-490f-8406-a7e18778ea6e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:20.734413 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d00bfa65-95d5-490f-8406-a7e18778ea6e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:20.735016 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d00bfa65-95d5-490f-8406-a7e18778ea6e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:20.735326 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d00bfa65-95d5-490f-8406-a7e18778ea6e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:20.736064 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d00bfa65-95d5-490f-8406-a7e18778ea6e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:20.736520 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d00bfa65-95d5-490f-8406-a7e18778ea6e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:20.736939 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d00bfa65-95d5-490f-8406-a7e18778ea6e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:20.799996 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-ef2a60e1-2f42-4ad6-a61a-53a496a51675 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:20.811663 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-ef2a60e1-2f42-4ad6-a61a-53a496a51675 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 200 len: 1265 microversion: 2.1 time: 0.775104 Aug 18 14:54:20.812598 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 223/440] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:20 2022] GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 1265 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:21.031924 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d00bfa65-95d5-490f-8406-a7e18778ea6e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:21.043481 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d00bfa65-95d5-490f-8406-a7e18778ea6e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:21.047572 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d00bfa65-95d5-490f-8406-a7e18778ea6e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:21.050476 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d00bfa65-95d5-490f-8406-a7e18778ea6e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1739 microversion: 2.20 time: 0.349428 Aug 18 14:54:21.053728 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 218/441] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:20 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1739 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:21.722386 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-2d10c5f1-0394-4a0e-ae0a-c069b7c2c0cf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:21.723318 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-2d10c5f1-0394-4a0e-ae0a-c069b7c2c0cf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:21.741340 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2d10c5f1-0394-4a0e-ae0a-c069b7c2c0cf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:21.741890 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2d10c5f1-0394-4a0e-ae0a-c069b7c2c0cf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:21.745483 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2d10c5f1-0394-4a0e-ae0a-c069b7c2c0cf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:21.746669 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2d10c5f1-0394-4a0e-ae0a-c069b7c2c0cf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:21.747311 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2d10c5f1-0394-4a0e-ae0a-c069b7c2c0cf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:21.747945 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2d10c5f1-0394-4a0e-ae0a-c069b7c2c0cf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:21.842661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0fab66d0-d255-4ead-a4be-8b967ee099d5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:21.846261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0fab66d0-d255-4ead-a4be-8b967ee099d5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:21.867518 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0fab66d0-d255-4ead-a4be-8b967ee099d5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:21.870442 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0fab66d0-d255-4ead-a4be-8b967ee099d5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:21.871260 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0fab66d0-d255-4ead-a4be-8b967ee099d5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:21.872249 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0fab66d0-d255-4ead-a4be-8b967ee099d5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:21.872905 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0fab66d0-d255-4ead-a4be-8b967ee099d5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:21.873529 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0fab66d0-d255-4ead-a4be-8b967ee099d5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:22.209077 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-2d10c5f1-0394-4a0e-ae0a-c069b7c2c0cf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:22.217360 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-2d10c5f1-0394-4a0e-ae0a-c069b7c2c0cf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.500415 Aug 18 14:54:22.220409 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 224/442] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:21 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:22.236878 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [req-d36f180f-34c8-45a0-b6f8-ab1c3305228f req-3f0fcd21-bec6-47be-bc69-eaf8085844cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80e04f79-c52c-4c8e-be85-d3beb6146729", "tag": "f09381f7-1a30-4400-be85-bedf9e4caa60"}]} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:54:22.254749 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-d36f180f-34c8-45a0-b6f8-ab1c3305228f req-3f0fcd21-bec6-47be-bc69-eaf8085844cf service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:22.255617 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-d36f180f-34c8-45a0-b6f8-ab1c3305228f req-3f0fcd21-bec6-47be-bc69-eaf8085844cf service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:22.256318 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [req-d36f180f-34c8-45a0-b6f8-ab1c3305228f req-3f0fcd21-bec6-47be-bc69-eaf8085844cf service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:22.297082 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-0fab66d0-d255-4ead-a4be-8b967ee099d5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:22.298661 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.compute.server_external_events [req-d36f180f-34c8-45a0-b6f8-ab1c3305228f req-3f0fcd21-bec6-47be-bc69-eaf8085844cf service nova] Creating event network-changed:f09381f7-1a30-4400-be85-bedf9e4caa60 for instance 80e04f79-c52c-4c8e-be85-d3beb6146729 on hv-cinder-85220 Aug 18 14:54:22.306852 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [req-d36f180f-34c8-45a0-b6f8-ab1c3305228f req-3f0fcd21-bec6-47be-bc69-eaf8085844cf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072119 Aug 18 14:54:22.308190 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 225/443] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:54:22.313296 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0fab66d0-d255-4ead-a4be-8b967ee099d5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 200 len: 1265 microversion: 2.1 time: 0.480006 Aug 18 14:54:22.314118 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-cdf18b16-6433-4be2-979b-4a38bfa3a285 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:22.314246 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 219/444] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:21 2022] GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 1265 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:22.315178 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-cdf18b16-6433-4be2-979b-4a38bfa3a285 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:22.322992 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-cdf18b16-6433-4be2-979b-4a38bfa3a285 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:22.323919 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-cdf18b16-6433-4be2-979b-4a38bfa3a285 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:22.324610 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-cdf18b16-6433-4be2-979b-4a38bfa3a285 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:22.326529 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-cdf18b16-6433-4be2-979b-4a38bfa3a285 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:22.327242 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-cdf18b16-6433-4be2-979b-4a38bfa3a285 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:22.327947 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-cdf18b16-6433-4be2-979b-4a38bfa3a285 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:22.821544 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-cdf18b16-6433-4be2-979b-4a38bfa3a285 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:22.838150 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-cdf18b16-6433-4be2-979b-4a38bfa3a285 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:22.844495 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-cdf18b16-6433-4be2-979b-4a38bfa3a285 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:22.848336 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-cdf18b16-6433-4be2-979b-4a38bfa3a285 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1739 microversion: 2.20 time: 0.538527 Aug 18 14:54:22.850004 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 226/445] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:22 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1739 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:23.269107 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-27f57fc8-4430-4747-84ad-5641b8f804e3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:23.271000 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-27f57fc8-4430-4747-84ad-5641b8f804e3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:23.289353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-27f57fc8-4430-4747-84ad-5641b8f804e3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:23.290245 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-27f57fc8-4430-4747-84ad-5641b8f804e3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:23.290977 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-27f57fc8-4430-4747-84ad-5641b8f804e3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:23.292254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-27f57fc8-4430-4747-84ad-5641b8f804e3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:23.293050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-27f57fc8-4430-4747-84ad-5641b8f804e3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:23.293733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-27f57fc8-4430-4747-84ad-5641b8f804e3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:23.335805 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-80bc69bc-0ad5-428c-a16e-ef6e4227c2d0 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:23.337666 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-80bc69bc-0ad5-428c-a16e-ef6e4227c2d0 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:23.348748 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:54:23.351987 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-80bc69bc-0ad5-428c-a16e-ef6e4227c2d0 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:23.352786 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-80bc69bc-0ad5-428c-a16e-ef6e4227c2d0 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:23.353539 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-80bc69bc-0ad5-428c-a16e-ef6e4227c2d0 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:23.354399 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-80bc69bc-0ad5-428c-a16e-ef6e4227c2d0 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:23.354860 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-80bc69bc-0ad5-428c-a16e-ef6e4227c2d0 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:23.355280 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-80bc69bc-0ad5-428c-a16e-ef6e4227c2d0 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:23.710363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-27f57fc8-4430-4747-84ad-5641b8f804e3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:23.720152 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-27f57fc8-4430-4747-84ad-5641b8f804e3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.471135 Aug 18 14:54:23.724260 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 220/446] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:23 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:23.736611 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-80bc69bc-0ad5-428c-a16e-ef6e4227c2d0 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:23.747292 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-80bc69bc-0ad5-428c-a16e-ef6e4227c2d0 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 200 len: 1265 microversion: 2.1 time: 0.416573 Aug 18 14:54:23.753106 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 227/447] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:23 2022] GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 1265 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:54:23.886324 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-9b93a408-2c20-4591-829b-2486739baf74 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:23.887353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-9b93a408-2c20-4591-829b-2486739baf74 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:23.902082 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9b93a408-2c20-4591-829b-2486739baf74 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:23.902854 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9b93a408-2c20-4591-829b-2486739baf74 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:23.903522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9b93a408-2c20-4591-829b-2486739baf74 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:23.904512 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9b93a408-2c20-4591-829b-2486739baf74 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:23.905203 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9b93a408-2c20-4591-829b-2486739baf74 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:23.905903 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9b93a408-2c20-4591-829b-2486739baf74 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:24.279393 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-9b93a408-2c20-4591-829b-2486739baf74 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:24.305455 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-9b93a408-2c20-4591-829b-2486739baf74 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:24.308748 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-9b93a408-2c20-4591-829b-2486739baf74 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:24.310979 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-9b93a408-2c20-4591-829b-2486739baf74 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1739 microversion: 2.20 time: 0.428652 Aug 18 14:54:24.341961 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 221/448] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:23 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1739 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:54:24.749783 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-78507e00-9038-4fe9-8932-4abd090046a0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:24.750682 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-78507e00-9038-4fe9-8932-4abd090046a0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:24.760814 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_cell0:SELECT=2 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:54:24.761779 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_cell0:SELECT=6 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:54:24.766214 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-78507e00-9038-4fe9-8932-4abd090046a0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:24.769411 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-78507e00-9038-4fe9-8932-4abd090046a0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:24.769983 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-78507e00-9038-4fe9-8932-4abd090046a0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:24.770694 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f5a08257-93ae-4974-9144-97ad51503cef tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:24.771307 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f5a08257-93ae-4974-9144-97ad51503cef tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:24.771487 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-78507e00-9038-4fe9-8932-4abd090046a0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:24.773753 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-78507e00-9038-4fe9-8932-4abd090046a0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:24.774358 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-78507e00-9038-4fe9-8932-4abd090046a0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:24.783836 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=2 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:54:24.788897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f5a08257-93ae-4974-9144-97ad51503cef tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:24.792820 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f5a08257-93ae-4974-9144-97ad51503cef tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:24.793545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f5a08257-93ae-4974-9144-97ad51503cef tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:24.794477 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f5a08257-93ae-4974-9144-97ad51503cef tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:24.800517 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f5a08257-93ae-4974-9144-97ad51503cef tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:24.801209 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f5a08257-93ae-4974-9144-97ad51503cef tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:25.344894 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-78507e00-9038-4fe9-8932-4abd090046a0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:25.354436 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f5a08257-93ae-4974-9144-97ad51503cef tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:25.372551 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-78507e00-9038-4fe9-8932-4abd090046a0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.614402 Aug 18 14:54:25.373961 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 228/449] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:24 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:25.378442 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f5a08257-93ae-4974-9144-97ad51503cef tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 200 len: 1265 microversion: 2.1 time: 0.610826 Aug 18 14:54:25.380150 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 222/450] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:24 2022] GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 1265 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:54:25.381481 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-60f498ac-abf6-4e5e-b693-c4eae5eb5727 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:25.382896 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-60f498ac-abf6-4e5e-b693-c4eae5eb5727 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:25.395313 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-60f498ac-abf6-4e5e-b693-c4eae5eb5727 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:25.396330 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-60f498ac-abf6-4e5e-b693-c4eae5eb5727 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:25.397173 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-60f498ac-abf6-4e5e-b693-c4eae5eb5727 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:25.398154 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-60f498ac-abf6-4e5e-b693-c4eae5eb5727 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:25.399385 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-60f498ac-abf6-4e5e-b693-c4eae5eb5727 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:25.400655 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-60f498ac-abf6-4e5e-b693-c4eae5eb5727 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:25.596063 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-60f498ac-abf6-4e5e-b693-c4eae5eb5727 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:25.609199 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-60f498ac-abf6-4e5e-b693-c4eae5eb5727 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:25.611198 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-60f498ac-abf6-4e5e-b693-c4eae5eb5727 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:25.612901 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-60f498ac-abf6-4e5e-b693-c4eae5eb5727 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1739 microversion: 2.20 time: 0.237635 Aug 18 14:54:25.613833 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 229/451] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:25 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:26.409591 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-73d1a389-43f8-4f10-acc3-8153aa44789a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:26.410726 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-73d1a389-43f8-4f10-acc3-8153aa44789a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:26.410834 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-0165e129-acbe-4ddf-9302-fe34f332d958 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:26.411393 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-0165e129-acbe-4ddf-9302-fe34f332d958 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:26.418467 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0165e129-acbe-4ddf-9302-fe34f332d958 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:26.418961 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0165e129-acbe-4ddf-9302-fe34f332d958 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:26.419381 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0165e129-acbe-4ddf-9302-fe34f332d958 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:26.420113 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0165e129-acbe-4ddf-9302-fe34f332d958 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:26.420567 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0165e129-acbe-4ddf-9302-fe34f332d958 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:26.420991 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0165e129-acbe-4ddf-9302-fe34f332d958 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:26.421209 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-73d1a389-43f8-4f10-acc3-8153aa44789a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:26.421996 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-73d1a389-43f8-4f10-acc3-8153aa44789a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:26.422719 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-73d1a389-43f8-4f10-acc3-8153aa44789a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:26.423927 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-73d1a389-43f8-4f10-acc3-8153aa44789a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:26.424694 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-73d1a389-43f8-4f10-acc3-8153aa44789a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:26.425423 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-73d1a389-43f8-4f10-acc3-8153aa44789a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:26.684920 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-0165e129-acbe-4ddf-9302-fe34f332d958 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:26.687654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-73d1a389-43f8-4f10-acc3-8153aa44789a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:26.697627 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-73d1a389-43f8-4f10-acc3-8153aa44789a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.295607 Aug 18 14:54:26.697842 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-0165e129-acbe-4ddf-9302-fe34f332d958 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 200 len: 1265 microversion: 2.1 time: 0.290705 Aug 18 14:54:26.698590 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 223/452] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:26 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:26.718741 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-68801be9-0b4f-4a06-8769-a94bf0df34de tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:26.718952 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 230/453] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:26 2022] GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 1265 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:26.719850 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-68801be9-0b4f-4a06-8769-a94bf0df34de tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:26.728259 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-68801be9-0b4f-4a06-8769-a94bf0df34de tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:26.729073 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-68801be9-0b4f-4a06-8769-a94bf0df34de tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:26.729699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-68801be9-0b4f-4a06-8769-a94bf0df34de tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:26.730600 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-68801be9-0b4f-4a06-8769-a94bf0df34de tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:26.731245 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-68801be9-0b4f-4a06-8769-a94bf0df34de tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:26.731709 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-68801be9-0b4f-4a06-8769-a94bf0df34de tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:26.926256 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-68801be9-0b4f-4a06-8769-a94bf0df34de tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:26.935146 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-68801be9-0b4f-4a06-8769-a94bf0df34de tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:26.936736 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-68801be9-0b4f-4a06-8769-a94bf0df34de tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:26.937938 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-68801be9-0b4f-4a06-8769-a94bf0df34de tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1721 microversion: 2.20 time: 0.224378 Aug 18 14:54:26.954974 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 224/454] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:26 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:27.731823 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-b373193d-5027-4003-a2dd-9ca174b1ade9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:27.733085 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d1d3de56-bb8d-4328-931d-da476a5d802d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:27.733827 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d1d3de56-bb8d-4328-931d-da476a5d802d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:27.737088 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-b373193d-5027-4003-a2dd-9ca174b1ade9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:27.743611 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d1d3de56-bb8d-4328-931d-da476a5d802d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:27.744714 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d1d3de56-bb8d-4328-931d-da476a5d802d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:27.745687 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d1d3de56-bb8d-4328-931d-da476a5d802d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:27.746641 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d1d3de56-bb8d-4328-931d-da476a5d802d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:27.747275 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d1d3de56-bb8d-4328-931d-da476a5d802d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:27.747869 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d1d3de56-bb8d-4328-931d-da476a5d802d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:27.761745 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b373193d-5027-4003-a2dd-9ca174b1ade9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:27.763121 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b373193d-5027-4003-a2dd-9ca174b1ade9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:27.765000 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b373193d-5027-4003-a2dd-9ca174b1ade9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:27.767670 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b373193d-5027-4003-a2dd-9ca174b1ade9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:27.768589 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b373193d-5027-4003-a2dd-9ca174b1ade9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:27.769557 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-b373193d-5027-4003-a2dd-9ca174b1ade9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:28.016622 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d1d3de56-bb8d-4328-931d-da476a5d802d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:28.026255 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d1d3de56-bb8d-4328-931d-da476a5d802d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 200 len: 1265 microversion: 2.1 time: 0.297555 Aug 18 14:54:28.028352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 225/455] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:27 2022] GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 1265 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:54:28.034278 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8fc9ecec-8fe0-478c-8d72-a07639648eaa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:28.035324 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-8fc9ecec-8fe0-478c-8d72-a07639648eaa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:28.042376 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8fc9ecec-8fe0-478c-8d72-a07639648eaa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:28.043482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8fc9ecec-8fe0-478c-8d72-a07639648eaa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:28.044271 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8fc9ecec-8fe0-478c-8d72-a07639648eaa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:28.045172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8fc9ecec-8fe0-478c-8d72-a07639648eaa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:28.045715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8fc9ecec-8fe0-478c-8d72-a07639648eaa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:28.046080 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8fc9ecec-8fe0-478c-8d72-a07639648eaa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:28.060558 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=100 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:54:28.153001 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-b373193d-5027-4003-a2dd-9ca174b1ade9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:28.167798 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-b373193d-5027-4003-a2dd-9ca174b1ade9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.446491 Aug 18 14:54:28.168729 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 231/456] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:27 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:28.240692 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8fc9ecec-8fe0-478c-8d72-a07639648eaa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:28.250340 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8fc9ecec-8fe0-478c-8d72-a07639648eaa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:28.252319 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8fc9ecec-8fe0-478c-8d72-a07639648eaa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:28.253832 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-8fc9ecec-8fe0-478c-8d72-a07639648eaa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1721 microversion: 2.20 time: 0.224326 Aug 18 14:54:28.254603 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 226/457] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:28 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:29.049217 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-a88b8424-4e84-454a-a9ec-41059b90acb8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:29.049829 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-a88b8424-4e84-454a-a9ec-41059b90acb8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:29.056844 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a88b8424-4e84-454a-a9ec-41059b90acb8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:29.057323 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a88b8424-4e84-454a-a9ec-41059b90acb8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:29.057750 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a88b8424-4e84-454a-a9ec-41059b90acb8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:29.058443 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a88b8424-4e84-454a-a9ec-41059b90acb8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:29.058892 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a88b8424-4e84-454a-a9ec-41059b90acb8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:29.059308 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a88b8424-4e84-454a-a9ec-41059b90acb8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:29.196407 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0f3afc5e-bd1e-409d-840a-7b71588a6a1b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:29.198044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0f3afc5e-bd1e-409d-840a-7b71588a6a1b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:29.206218 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0f3afc5e-bd1e-409d-840a-7b71588a6a1b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:29.206960 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0f3afc5e-bd1e-409d-840a-7b71588a6a1b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:29.207576 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0f3afc5e-bd1e-409d-840a-7b71588a6a1b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:29.208846 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0f3afc5e-bd1e-409d-840a-7b71588a6a1b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:29.209470 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0f3afc5e-bd1e-409d-840a-7b71588a6a1b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:29.210484 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0f3afc5e-bd1e-409d-840a-7b71588a6a1b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:29.274706 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-a88b8424-4e84-454a-a9ec-41059b90acb8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:29.300737 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-a88b8424-4e84-454a-a9ec-41059b90acb8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 200 len: 1265 microversion: 2.1 time: 0.255309 Aug 18 14:54:29.306090 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 232/458] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:29 2022] GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:29.337275 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-4c0ec314-72ac-47e3-951d-84e4cbd8fdaa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:29.339011 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-4c0ec314-72ac-47e3-951d-84e4cbd8fdaa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:29.352767 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4c0ec314-72ac-47e3-951d-84e4cbd8fdaa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:29.354076 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4c0ec314-72ac-47e3-951d-84e4cbd8fdaa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:29.355060 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4c0ec314-72ac-47e3-951d-84e4cbd8fdaa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:29.356769 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4c0ec314-72ac-47e3-951d-84e4cbd8fdaa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:29.357535 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4c0ec314-72ac-47e3-951d-84e4cbd8fdaa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:29.358486 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-4c0ec314-72ac-47e3-951d-84e4cbd8fdaa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:29.367411 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_cell1:SELECT=100 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:54:29.608497 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-0f3afc5e-bd1e-409d-840a-7b71588a6a1b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:29.619818 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0f3afc5e-bd1e-409d-840a-7b71588a6a1b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.427411 Aug 18 14:54:29.620573 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 227/459] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:29 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:29.625695 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-21c1f5fe-e686-4c8e-b989-4096f717e4db req-d3200883-ca79-4444-9966-8c1838bac5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2b6fc4-0338-4141-9ac3-7b579718fae9", "name": "network-vif-unplugged", "status": "completed", "tag": "54c7f937-7b5c-43bd-9d41-2e0484619d5f"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:54:29.640185 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-21c1f5fe-e686-4c8e-b989-4096f717e4db req-d3200883-ca79-4444-9966-8c1838bac5e6 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:29.640704 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-21c1f5fe-e686-4c8e-b989-4096f717e4db req-d3200883-ca79-4444-9966-8c1838bac5e6 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:29.641132 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-21c1f5fe-e686-4c8e-b989-4096f717e4db req-d3200883-ca79-4444-9966-8c1838bac5e6 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:29.658265 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-21c1f5fe-e686-4c8e-b989-4096f717e4db req-d3200883-ca79-4444-9966-8c1838bac5e6 service nova] Creating event network-vif-unplugged:54c7f937-7b5c-43bd-9d41-2e0484619d5f for instance 3d2b6fc4-0338-4141-9ac3-7b579718fae9 on hv-cinder-85220 Aug 18 14:54:29.658423 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-4c0ec314-72ac-47e3-951d-84e4cbd8fdaa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:29.666214 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-21c1f5fe-e686-4c8e-b989-4096f717e4db req-d3200883-ca79-4444-9966-8c1838bac5e6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043913 Aug 18 14:54:29.667222 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 228/460] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:54:29.668071 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-4c0ec314-72ac-47e3-951d-84e4cbd8fdaa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:29.670066 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-4c0ec314-72ac-47e3-951d-84e4cbd8fdaa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:29.671908 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-4c0ec314-72ac-47e3-951d-84e4cbd8fdaa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1721 microversion: 2.20 time: 0.358474 Aug 18 14:54:29.674726 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 233/461] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:29 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1721 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:30.326059 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a8d116d6-38fe-4dc9-bb15-5610d002df6c tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:30.327410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a8d116d6-38fe-4dc9-bb15-5610d002df6c tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:30.334921 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a8d116d6-38fe-4dc9-bb15-5610d002df6c tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:30.335797 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a8d116d6-38fe-4dc9-bb15-5610d002df6c tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:30.336416 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a8d116d6-38fe-4dc9-bb15-5610d002df6c tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:30.337320 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a8d116d6-38fe-4dc9-bb15-5610d002df6c tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:30.337788 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a8d116d6-38fe-4dc9-bb15-5610d002df6c tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:30.338232 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a8d116d6-38fe-4dc9-bb15-5610d002df6c tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:30.494045 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a8d116d6-38fe-4dc9-bb15-5610d002df6c tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:30.502323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a8d116d6-38fe-4dc9-bb15-5610d002df6c tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 200 len: 1265 microversion: 2.1 time: 0.180734 Aug 18 14:54:30.503349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 229/462] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:30 2022] GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:30.644559 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-8d383ef8-f6d5-4298-8d6b-b76e8dcaad11 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:30.646056 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-8d383ef8-f6d5-4298-8d6b-b76e8dcaad11 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:30.653483 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8d383ef8-f6d5-4298-8d6b-b76e8dcaad11 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:30.654014 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8d383ef8-f6d5-4298-8d6b-b76e8dcaad11 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:30.654716 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8d383ef8-f6d5-4298-8d6b-b76e8dcaad11 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:30.655382 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8d383ef8-f6d5-4298-8d6b-b76e8dcaad11 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:30.656032 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8d383ef8-f6d5-4298-8d6b-b76e8dcaad11 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:30.656655 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8d383ef8-f6d5-4298-8d6b-b76e8dcaad11 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:30.702222 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-935a65af-6587-4a44-b28d-9fc0c88437d2 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:30.703639 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-935a65af-6587-4a44-b28d-9fc0c88437d2 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:30.715578 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-935a65af-6587-4a44-b28d-9fc0c88437d2 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:30.716714 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-935a65af-6587-4a44-b28d-9fc0c88437d2 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:30.718224 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-935a65af-6587-4a44-b28d-9fc0c88437d2 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:30.719999 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-935a65af-6587-4a44-b28d-9fc0c88437d2 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:30.724324 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-935a65af-6587-4a44-b28d-9fc0c88437d2 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:30.725480 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-935a65af-6587-4a44-b28d-9fc0c88437d2 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:30.931068 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-8d383ef8-f6d5-4298-8d6b-b76e8dcaad11 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:30.941797 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-8d383ef8-f6d5-4298-8d6b-b76e8dcaad11 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.302286 Aug 18 14:54:30.942392 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 234/463] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:30 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:31.001299 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-935a65af-6587-4a44-b28d-9fc0c88437d2 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:31.014450 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-935a65af-6587-4a44-b28d-9fc0c88437d2 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:31.016151 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-935a65af-6587-4a44-b28d-9fc0c88437d2 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:31.018329 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-935a65af-6587-4a44-b28d-9fc0c88437d2 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1721 microversion: 2.20 time: 0.324866 Aug 18 14:54:31.018329 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 230/464] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:30 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1721 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:54:31.524268 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-dbe3a4b3-c0d8-40f5-92fd-2f79f5ef0fa5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:31.524922 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-dbe3a4b3-c0d8-40f5-92fd-2f79f5ef0fa5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:31.531510 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-dbe3a4b3-c0d8-40f5-92fd-2f79f5ef0fa5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:31.532199 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-dbe3a4b3-c0d8-40f5-92fd-2f79f5ef0fa5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:31.532509 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-dbe3a4b3-c0d8-40f5-92fd-2f79f5ef0fa5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:31.533255 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-dbe3a4b3-c0d8-40f5-92fd-2f79f5ef0fa5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:31.533731 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-dbe3a4b3-c0d8-40f5-92fd-2f79f5ef0fa5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:31.534179 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-dbe3a4b3-c0d8-40f5-92fd-2f79f5ef0fa5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:31.760716 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-dbe3a4b3-c0d8-40f5-92fd-2f79f5ef0fa5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:31.785331 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-dbe3a4b3-c0d8-40f5-92fd-2f79f5ef0fa5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 200 len: 1265 microversion: 2.1 time: 0.265050 Aug 18 14:54:31.798572 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 235/465] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:31 2022] GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 1265 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:31.973742 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-967f8dc8-ab04-407b-a326-c35812c3548e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:31.974970 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-967f8dc8-ab04-407b-a326-c35812c3548e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:31.983639 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-967f8dc8-ab04-407b-a326-c35812c3548e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:31.984269 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-967f8dc8-ab04-407b-a326-c35812c3548e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:31.984771 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-967f8dc8-ab04-407b-a326-c35812c3548e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:31.985508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-967f8dc8-ab04-407b-a326-c35812c3548e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:31.985958 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-967f8dc8-ab04-407b-a326-c35812c3548e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:31.986371 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-967f8dc8-ab04-407b-a326-c35812c3548e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:32.045577 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-d6fea872-9c25-43d9-b0ae-f3c0065f9716 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:32.046126 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-d6fea872-9c25-43d9-b0ae-f3c0065f9716 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:32.052208 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d6fea872-9c25-43d9-b0ae-f3c0065f9716 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:32.052698 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d6fea872-9c25-43d9-b0ae-f3c0065f9716 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:32.053126 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d6fea872-9c25-43d9-b0ae-f3c0065f9716 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:32.053832 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d6fea872-9c25-43d9-b0ae-f3c0065f9716 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:32.054282 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d6fea872-9c25-43d9-b0ae-f3c0065f9716 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:32.055299 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d6fea872-9c25-43d9-b0ae-f3c0065f9716 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:32.289069 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-967f8dc8-ab04-407b-a326-c35812c3548e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:32.298044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-967f8dc8-ab04-407b-a326-c35812c3548e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1522 microversion: 2.1 time: 0.329128 Aug 18 14:54:32.298540 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 231/466] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:31 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:32.302687 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-d6fea872-9c25-43d9-b0ae-f3c0065f9716 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:32.318953 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-d6fea872-9c25-43d9-b0ae-f3c0065f9716 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:32.321070 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-d6fea872-9c25-43d9-b0ae-f3c0065f9716 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:32.322240 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-d6fea872-9c25-43d9-b0ae-f3c0065f9716 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1721 microversion: 2.20 time: 0.280776 Aug 18 14:54:32.322796 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 236/467] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:32 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1721 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:54:32.807733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-4f76581a-0362-4b3e-8eaf-e825ee09243f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:32.808342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-4f76581a-0362-4b3e-8eaf-e825ee09243f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:32.814418 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4f76581a-0362-4b3e-8eaf-e825ee09243f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:32.814904 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4f76581a-0362-4b3e-8eaf-e825ee09243f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:32.815336 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4f76581a-0362-4b3e-8eaf-e825ee09243f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:32.816072 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4f76581a-0362-4b3e-8eaf-e825ee09243f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:32.816522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4f76581a-0362-4b3e-8eaf-e825ee09243f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:32.816944 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4f76581a-0362-4b3e-8eaf-e825ee09243f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:32.907480 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-55af5259-a6bb-4386-a1d0-0108684a4d82 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f28f46bf-9b3f-4d46-a63b-e47f0194d688", "device": "/dev/sdb"}} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:54:32.910371 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-55af5259-a6bb-4386-a1d0-0108684a4d82 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: e198b9cf-f1a2-4568-831d-201df30f8dec] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:32.916621 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-55af5259-a6bb-4386-a1d0-0108684a4d82 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:32.917107 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-55af5259-a6bb-4386-a1d0-0108684a4d82 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:32.917539 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-55af5259-a6bb-4386-a1d0-0108684a4d82 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:32.918241 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-55af5259-a6bb-4386-a1d0-0108684a4d82 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:32.918686 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-55af5259-a6bb-4386-a1d0-0108684a4d82 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:32.919295 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-55af5259-a6bb-4386-a1d0-0108684a4d82 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:32.973078 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-4f76581a-0362-4b3e-8eaf-e825ee09243f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:32.982410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-4f76581a-0362-4b3e-8eaf-e825ee09243f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 200 len: 1265 microversion: 2.1 time: 0.179152 Aug 18 14:54:32.996442 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 232/468] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:32 2022] GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:33.320083 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b801ba77-66ef-469f-bad5-0a1c61e043bc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:33.320632 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b801ba77-66ef-469f-bad5-0a1c61e043bc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:33.327577 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b801ba77-66ef-469f-bad5-0a1c61e043bc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:33.328073 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b801ba77-66ef-469f-bad5-0a1c61e043bc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:33.328500 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b801ba77-66ef-469f-bad5-0a1c61e043bc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:33.329225 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b801ba77-66ef-469f-bad5-0a1c61e043bc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:33.329755 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b801ba77-66ef-469f-bad5-0a1c61e043bc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:33.330181 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b801ba77-66ef-469f-bad5-0a1c61e043bc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:33.506883 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b801ba77-66ef-469f-bad5-0a1c61e043bc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:33.515074 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b801ba77-66ef-469f-bad5-0a1c61e043bc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1502 microversion: 2.1 time: 0.199390 Aug 18 14:54:33.515657 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 233/469] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:33 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1502 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:54:33.520186 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-396664a7-4d77-4984-9d49-c6ad8ca4388a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:33.520793 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-396664a7-4d77-4984-9d49-c6ad8ca4388a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:33.527274 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-396664a7-4d77-4984-9d49-c6ad8ca4388a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:33.527793 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-396664a7-4d77-4984-9d49-c6ad8ca4388a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:33.528226 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-396664a7-4d77-4984-9d49-c6ad8ca4388a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:33.528932 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-396664a7-4d77-4984-9d49-c6ad8ca4388a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:33.529382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-396664a7-4d77-4984-9d49-c6ad8ca4388a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:33.529800 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-396664a7-4d77-4984-9d49-c6ad8ca4388a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:33.674378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-396664a7-4d77-4984-9d49-c6ad8ca4388a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:33.683053 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-396664a7-4d77-4984-9d49-c6ad8ca4388a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:33.684588 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-396664a7-4d77-4984-9d49-c6ad8ca4388a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:33.685787 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-396664a7-4d77-4984-9d49-c6ad8ca4388a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1721 microversion: 2.20 time: 0.169173 Aug 18 14:54:33.686369 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 234/470] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:33 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:33.691507 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-1711fe65-527a-4066-88d0-4c909e8cdd5f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:33.692163 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-1711fe65-527a-4066-88d0-4c909e8cdd5f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:33.698217 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1711fe65-527a-4066-88d0-4c909e8cdd5f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:33.698703 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1711fe65-527a-4066-88d0-4c909e8cdd5f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:33.699140 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1711fe65-527a-4066-88d0-4c909e8cdd5f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:33.699866 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1711fe65-527a-4066-88d0-4c909e8cdd5f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:33.700324 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1711fe65-527a-4066-88d0-4c909e8cdd5f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:33.700746 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1711fe65-527a-4066-88d0-4c909e8cdd5f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:33.846228 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-1711fe65-527a-4066-88d0-4c909e8cdd5f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:33.854623 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-1711fe65-527a-4066-88d0-4c909e8cdd5f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1515 microversion: 2.1 time: 0.166991 Aug 18 14:54:33.855427 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 235/471] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:33 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:34.005023 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e57aeac7-3b46-4922-b3b8-ce08f234210a tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:34.005649 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e57aeac7-3b46-4922-b3b8-ce08f234210a tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:34.013464 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e57aeac7-3b46-4922-b3b8-ce08f234210a tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:34.013954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e57aeac7-3b46-4922-b3b8-ce08f234210a tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:34.014419 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e57aeac7-3b46-4922-b3b8-ce08f234210a tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:34.015129 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e57aeac7-3b46-4922-b3b8-ce08f234210a tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:34.015591 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e57aeac7-3b46-4922-b3b8-ce08f234210a tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:34.016230 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e57aeac7-3b46-4922-b3b8-ce08f234210a tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:34.188088 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e57aeac7-3b46-4922-b3b8-ce08f234210a tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:34.197559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e57aeac7-3b46-4922-b3b8-ce08f234210a tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 200 len: 1265 microversion: 2.1 time: 0.196278 Aug 18 14:54:34.198664 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 236/472] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:33 2022] GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:54:34.709669 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-db6e448a-3d9b-4c2f-aa7c-7e7f17dee408 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:34.710839 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-db6e448a-3d9b-4c2f-aa7c-7e7f17dee408 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:34.713074 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=88 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:54:34.718898 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-db6e448a-3d9b-4c2f-aa7c-7e7f17dee408 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:34.719387 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-db6e448a-3d9b-4c2f-aa7c-7e7f17dee408 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:34.719860 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-db6e448a-3d9b-4c2f-aa7c-7e7f17dee408 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:34.720571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-db6e448a-3d9b-4c2f-aa7c-7e7f17dee408 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:34.721052 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-db6e448a-3d9b-4c2f-aa7c-7e7f17dee408 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:34.721472 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-db6e448a-3d9b-4c2f-aa7c-7e7f17dee408 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:34.869603 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-db6e448a-3d9b-4c2f-aa7c-7e7f17dee408 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:34.878463 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-db6e448a-3d9b-4c2f-aa7c-7e7f17dee408 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:34.880127 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-db6e448a-3d9b-4c2f-aa7c-7e7f17dee408 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:34.881378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-db6e448a-3d9b-4c2f-aa7c-7e7f17dee408 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1721 microversion: 2.20 time: 0.175799 Aug 18 14:54:34.882030 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 237/473] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:34 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:54:35.224591 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-bb451594-0f07-4bca-bd03-404f93cd118f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:35.226377 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-bb451594-0f07-4bca-bd03-404f93cd118f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:35.233060 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bb451594-0f07-4bca-bd03-404f93cd118f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:35.234028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bb451594-0f07-4bca-bd03-404f93cd118f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:35.234621 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bb451594-0f07-4bca-bd03-404f93cd118f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:35.236381 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bb451594-0f07-4bca-bd03-404f93cd118f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:35.236862 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bb451594-0f07-4bca-bd03-404f93cd118f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:35.237293 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bb451594-0f07-4bca-bd03-404f93cd118f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:35.494065 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-55af5259-a6bb-4386-a1d0-0108684a4d82 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "POST /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.588440 Aug 18 14:54:35.495712 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 237/474] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Aug 18 14:54:32 2022] POST /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec/os-volume_attachments => generated 194 bytes in 2593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:54:35.507256 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-067ba63f-65c1-40a3-8dc4-a97d97da53b2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:54:35.514136 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-067ba63f-65c1-40a3-8dc4-a97d97da53b2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:35.525040 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-067ba63f-65c1-40a3-8dc4-a97d97da53b2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:35.525692 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-067ba63f-65c1-40a3-8dc4-a97d97da53b2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:35.526652 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-067ba63f-65c1-40a3-8dc4-a97d97da53b2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:35.528316 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-067ba63f-65c1-40a3-8dc4-a97d97da53b2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:35.529578 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-067ba63f-65c1-40a3-8dc4-a97d97da53b2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:35.530297 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-067ba63f-65c1-40a3-8dc4-a97d97da53b2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:35.555246 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-bb451594-0f07-4bca-bd03-404f93cd118f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:35.566701 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-bb451594-0f07-4bca-bd03-404f93cd118f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 200 len: 1265 microversion: 2.1 time: 0.352019 Aug 18 14:54:35.571375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 238/475] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:35 2022] GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 1265 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:35.578395 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-0aec6b26-5261-4b5f-b019-cb65d82205b7 req-37cbc53b-267c-4154-af08-1982cdf462f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80e04f79-c52c-4c8e-be85-d3beb6146729", "name": "network-vif-plugged", "status": "completed", "tag": "f09381f7-1a30-4400-be85-bedf9e4caa60"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:54:35.603776 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-0aec6b26-5261-4b5f-b019-cb65d82205b7 req-37cbc53b-267c-4154-af08-1982cdf462f6 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:35.604461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-0aec6b26-5261-4b5f-b019-cb65d82205b7 req-37cbc53b-267c-4154-af08-1982cdf462f6 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:35.608860 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-0aec6b26-5261-4b5f-b019-cb65d82205b7 req-37cbc53b-267c-4154-af08-1982cdf462f6 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:35.636430 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-0aec6b26-5261-4b5f-b019-cb65d82205b7 req-37cbc53b-267c-4154-af08-1982cdf462f6 service nova] Creating event network-vif-plugged:f09381f7-1a30-4400-be85-bedf9e4caa60 for instance 80e04f79-c52c-4c8e-be85-d3beb6146729 on hv-cinder-85220 Aug 18 14:54:35.642861 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-0aec6b26-5261-4b5f-b019-cb65d82205b7 req-37cbc53b-267c-4154-af08-1982cdf462f6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070040 Aug 18 14:54:35.643644 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 239/476] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:54:35.653009 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.objects.instance [None req-067ba63f-65c1-40a3-8dc4-a97d97da53b2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lazy-loading 'flavor' on Instance uuid 15c8904a-619f-4137-9ab6-6231d51327db {{(pid=132267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:54:35.747519 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-067ba63f-65c1-40a3-8dc4-a97d97da53b2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "POST /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db/action" status: 200 len: 32 microversion: 2.1 time: 0.247812 Aug 18 14:54:35.748191 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 238/477] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Aug 18 14:54:35 2022] POST /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db/action => generated 32 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 14:54:35.758285 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-05951f20-b85e-4710-bfc0-e4a3ba32a749 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:35.759335 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-05951f20-b85e-4710-bfc0-e4a3ba32a749 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:35.766378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-05951f20-b85e-4710-bfc0-e4a3ba32a749 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:35.766871 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-05951f20-b85e-4710-bfc0-e4a3ba32a749 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:35.767357 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-05951f20-b85e-4710-bfc0-e4a3ba32a749 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:35.768114 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-05951f20-b85e-4710-bfc0-e4a3ba32a749 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:35.768800 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-05951f20-b85e-4710-bfc0-e4a3ba32a749 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:35.769220 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-05951f20-b85e-4710-bfc0-e4a3ba32a749 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:35.907229 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-c16f19d5-4ab6-4410-89a0-5075eee9e01e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:35.908109 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-c16f19d5-4ab6-4410-89a0-5075eee9e01e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:35.916487 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-05951f20-b85e-4710-bfc0-e4a3ba32a749 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:35.918569 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c16f19d5-4ab6-4410-89a0-5075eee9e01e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:35.919048 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c16f19d5-4ab6-4410-89a0-5075eee9e01e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:35.919481 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c16f19d5-4ab6-4410-89a0-5075eee9e01e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:35.920250 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c16f19d5-4ab6-4410-89a0-5075eee9e01e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:35.920707 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c16f19d5-4ab6-4410-89a0-5075eee9e01e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:35.921133 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c16f19d5-4ab6-4410-89a0-5075eee9e01e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:35.934016 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-05951f20-b85e-4710-bfc0-e4a3ba32a749 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.179888 Aug 18 14:54:35.935257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 240/478] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:35 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:36.095193 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-c16f19d5-4ab6-4410-89a0-5075eee9e01e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:36.124831 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-c16f19d5-4ab6-4410-89a0-5075eee9e01e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:36.126492 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-c16f19d5-4ab6-4410-89a0-5075eee9e01e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:36.127709 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-c16f19d5-4ab6-4410-89a0-5075eee9e01e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1724 microversion: 2.20 time: 0.225443 Aug 18 14:54:36.134193 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 239/479] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:35 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:36.152973 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-bfbfeca5-78c8-4d1c-9116-4e023c7fa53a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db06abe4-7e23-4d75-ace2-c9ea021dfebc"}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:54:36.155642 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-bfbfeca5-78c8-4d1c-9116-4e023c7fa53a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:36.163495 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bfbfeca5-78c8-4d1c-9116-4e023c7fa53a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:36.164292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bfbfeca5-78c8-4d1c-9116-4e023c7fa53a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:36.164935 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bfbfeca5-78c8-4d1c-9116-4e023c7fa53a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:36.165980 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bfbfeca5-78c8-4d1c-9116-4e023c7fa53a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:36.166926 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bfbfeca5-78c8-4d1c-9116-4e023c7fa53a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:36.167854 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bfbfeca5-78c8-4d1c-9116-4e023c7fa53a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:36.532581 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:54:36.550055 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-bfbfeca5-78c8-4d1c-9116-4e023c7fa53a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "POST /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.401829 Aug 18 14:54:36.550698 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 241/480] 10.222.0.36 () {62 vars in 1364 bytes} [Thu Aug 18 14:54:36 2022] POST /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9/os-volume_attachments => generated 188 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 14:54:36.594632 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-a1751d54-abac-4503-926e-7ddf088ccbd2 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:36.595857 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-a1751d54-abac-4503-926e-7ddf088ccbd2 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:36.603549 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a1751d54-abac-4503-926e-7ddf088ccbd2 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:36.604164 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a1751d54-abac-4503-926e-7ddf088ccbd2 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:36.604650 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a1751d54-abac-4503-926e-7ddf088ccbd2 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:36.605604 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a1751d54-abac-4503-926e-7ddf088ccbd2 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:36.606070 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a1751d54-abac-4503-926e-7ddf088ccbd2 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:36.606491 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a1751d54-abac-4503-926e-7ddf088ccbd2 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:36.703772 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-43ca4310-23e9-45f8-a6c8-8efce39a0d88 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:54:36.704649 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-43ca4310-23e9-45f8-a6c8-8efce39a0d88 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:36.713536 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-43ca4310-23e9-45f8-a6c8-8efce39a0d88 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:36.714044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-43ca4310-23e9-45f8-a6c8-8efce39a0d88 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:36.714475 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-43ca4310-23e9-45f8-a6c8-8efce39a0d88 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:36.716240 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-43ca4310-23e9-45f8-a6c8-8efce39a0d88 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:36.716911 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-43ca4310-23e9-45f8-a6c8-8efce39a0d88 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:36.717517 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-43ca4310-23e9-45f8-a6c8-8efce39a0d88 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:36.788459 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-43ca4310-23e9-45f8-a6c8-8efce39a0d88 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132268) unshelve /opt/stack/nova/nova/compute/api.py:4587}} Aug 18 14:54:36.829802 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-a1751d54-abac-4503-926e-7ddf088ccbd2 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:36.849195 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-a1751d54-abac-4503-926e-7ddf088ccbd2 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 200 len: 1265 microversion: 2.1 time: 0.259015 Aug 18 14:54:36.850071 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 240/481] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:36 2022] GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:36.864909 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-43ca4310-23e9-45f8-a6c8-8efce39a0d88 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "POST /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9/action" status: 202 len: 0 microversion: 2.20 time: 0.166067 Aug 18 14:54:36.865663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 242/482] 10.222.0.36 () {62 vars in 1319 bytes} [Thu Aug 18 14:54:36 2022] POST /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 18 14:54:36.875294 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-bd7bdc21-19de-4d0b-bc3c-4c9dab298325 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:36.876032 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-bd7bdc21-19de-4d0b-bc3c-4c9dab298325 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:36.884227 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-bd7bdc21-19de-4d0b-bc3c-4c9dab298325 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:36.884892 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-bd7bdc21-19de-4d0b-bc3c-4c9dab298325 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:36.885384 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-bd7bdc21-19de-4d0b-bc3c-4c9dab298325 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:36.886239 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-bd7bdc21-19de-4d0b-bc3c-4c9dab298325 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:36.886988 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-bd7bdc21-19de-4d0b-bc3c-4c9dab298325 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:36.887635 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-bd7bdc21-19de-4d0b-bc3c-4c9dab298325 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:36.964831 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-07fed8d5-3800-48d5-bf4f-d9075ca27f04 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:36.965549 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-07fed8d5-3800-48d5-bf4f-d9075ca27f04 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:36.975662 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-07fed8d5-3800-48d5-bf4f-d9075ca27f04 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:36.977028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-07fed8d5-3800-48d5-bf4f-d9075ca27f04 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:36.977691 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-07fed8d5-3800-48d5-bf4f-d9075ca27f04 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:36.978584 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-07fed8d5-3800-48d5-bf4f-d9075ca27f04 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:36.979217 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-07fed8d5-3800-48d5-bf4f-d9075ca27f04 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:36.980214 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-07fed8d5-3800-48d5-bf4f-d9075ca27f04 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:37.055761 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-bd7bdc21-19de-4d0b-bc3c-4c9dab298325 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:37.067051 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-bd7bdc21-19de-4d0b-bc3c-4c9dab298325 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:37.072356 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-bd7bdc21-19de-4d0b-bc3c-4c9dab298325 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:37.077681 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-bd7bdc21-19de-4d0b-bc3c-4c9dab298325 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1810 microversion: 2.20 time: 0.206274 Aug 18 14:54:37.078696 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 241/483] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:36 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1810 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:37.147213 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-07fed8d5-3800-48d5-bf4f-d9075ca27f04 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:37.158894 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-07fed8d5-3800-48d5-bf4f-d9075ca27f04 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.202014 Aug 18 14:54:37.159797 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 243/484] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:36 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:54:37.873129 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-0c580770-4ff7-40c5-ae70-836f73bfcd30 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:37.873754 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-0c580770-4ff7-40c5-ae70-836f73bfcd30 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:37.880582 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0c580770-4ff7-40c5-ae70-836f73bfcd30 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:37.881602 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0c580770-4ff7-40c5-ae70-836f73bfcd30 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:37.881602 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0c580770-4ff7-40c5-ae70-836f73bfcd30 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:37.882182 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0c580770-4ff7-40c5-ae70-836f73bfcd30 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:37.882672 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0c580770-4ff7-40c5-ae70-836f73bfcd30 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:37.883097 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0c580770-4ff7-40c5-ae70-836f73bfcd30 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:38.103408 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-189663c8-f3e2-4896-9b17-b7d4b2b6f0d3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:38.105344 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-189663c8-f3e2-4896-9b17-b7d4b2b6f0d3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:38.114085 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-189663c8-f3e2-4896-9b17-b7d4b2b6f0d3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:38.114786 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-189663c8-f3e2-4896-9b17-b7d4b2b6f0d3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:38.115360 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-189663c8-f3e2-4896-9b17-b7d4b2b6f0d3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:38.116294 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-189663c8-f3e2-4896-9b17-b7d4b2b6f0d3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:38.118225 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-189663c8-f3e2-4896-9b17-b7d4b2b6f0d3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:38.119110 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-189663c8-f3e2-4896-9b17-b7d4b2b6f0d3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:38.128217 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-0c580770-4ff7-40c5-ae70-836f73bfcd30 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:38.136750 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-0c580770-4ff7-40c5-ae70-836f73bfcd30 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 200 len: 1265 microversion: 2.1 time: 0.270105 Aug 18 14:54:38.137326 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 242/485] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:37 2022] GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 1265 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:38.181405 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-ee92dd26-b8ca-4e08-8b5b-d74ecf28b570 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:38.182029 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-ee92dd26-b8ca-4e08-8b5b-d74ecf28b570 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:38.188274 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ee92dd26-b8ca-4e08-8b5b-d74ecf28b570 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:38.188858 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ee92dd26-b8ca-4e08-8b5b-d74ecf28b570 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:38.189608 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ee92dd26-b8ca-4e08-8b5b-d74ecf28b570 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:38.190581 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ee92dd26-b8ca-4e08-8b5b-d74ecf28b570 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:38.190921 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ee92dd26-b8ca-4e08-8b5b-d74ecf28b570 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:38.191417 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ee92dd26-b8ca-4e08-8b5b-d74ecf28b570 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:38.294619 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-189663c8-f3e2-4896-9b17-b7d4b2b6f0d3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:38.303740 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-189663c8-f3e2-4896-9b17-b7d4b2b6f0d3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:38.305415 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-189663c8-f3e2-4896-9b17-b7d4b2b6f0d3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:38.306535 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-189663c8-f3e2-4896-9b17-b7d4b2b6f0d3 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1750 microversion: 2.20 time: 0.209373 Aug 18 14:54:38.307091 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 244/486] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:38 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1750 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:54:38.340724 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-ee92dd26-b8ca-4e08-8b5b-d74ecf28b570 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:38.348607 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-ee92dd26-b8ca-4e08-8b5b-d74ecf28b570 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.171074 Aug 18 14:54:38.349182 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 243/487] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:38 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:54:39.158150 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-dbd60585-0266-4071-bf2f-2df97179dfd1 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:39.158697 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-dbd60585-0266-4071-bf2f-2df97179dfd1 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:39.165552 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dbd60585-0266-4071-bf2f-2df97179dfd1 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:39.166048 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dbd60585-0266-4071-bf2f-2df97179dfd1 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:39.166465 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dbd60585-0266-4071-bf2f-2df97179dfd1 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:39.167146 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dbd60585-0266-4071-bf2f-2df97179dfd1 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:39.167600 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dbd60585-0266-4071-bf2f-2df97179dfd1 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:39.168049 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dbd60585-0266-4071-bf2f-2df97179dfd1 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:39.298813 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-dbd60585-0266-4071-bf2f-2df97179dfd1 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:39.307455 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-dbd60585-0266-4071-bf2f-2df97179dfd1 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 200 len: 1452 microversion: 2.1 time: 0.153225 Aug 18 14:54:39.308038 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 245/488] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:39 2022] GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:39.328136 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-a67f39ec-c8f7-42f5-8681-0027e9e36aae tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:39.328752 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-a67f39ec-c8f7-42f5-8681-0027e9e36aae tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:39.329799 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ff563fb1-35db-4ce0-bcef-cc20b538119f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:39.330402 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ff563fb1-35db-4ce0-bcef-cc20b538119f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:39.335182 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a67f39ec-c8f7-42f5-8681-0027e9e36aae tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:39.335659 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a67f39ec-c8f7-42f5-8681-0027e9e36aae tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:39.336121 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a67f39ec-c8f7-42f5-8681-0027e9e36aae tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:39.336273 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ff563fb1-35db-4ce0-bcef-cc20b538119f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:39.336747 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ff563fb1-35db-4ce0-bcef-cc20b538119f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:39.336857 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a67f39ec-c8f7-42f5-8681-0027e9e36aae tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:39.337168 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ff563fb1-35db-4ce0-bcef-cc20b538119f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:39.337268 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a67f39ec-c8f7-42f5-8681-0027e9e36aae tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:39.337660 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-a67f39ec-c8f7-42f5-8681-0027e9e36aae tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:39.337847 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ff563fb1-35db-4ce0-bcef-cc20b538119f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:39.338291 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ff563fb1-35db-4ce0-bcef-cc20b538119f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:39.338704 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ff563fb1-35db-4ce0-bcef-cc20b538119f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:39.527418 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-a67f39ec-c8f7-42f5-8681-0027e9e36aae tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:39.535141 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-a67f39ec-c8f7-42f5-8681-0027e9e36aae tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 200 len: 1452 microversion: 2.1 time: 0.211028 Aug 18 14:54:39.536027 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 244/489] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:39 2022] GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 1452 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:39.538556 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ff563fb1-35db-4ce0-bcef-cc20b538119f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:39.540992 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-70772751-a16a-4228-9047-a3cb61bf1089 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:39.541595 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-70772751-a16a-4228-9047-a3cb61bf1089 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:39.547255 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-70772751-a16a-4228-9047-a3cb61bf1089 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:39.547761 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-70772751-a16a-4228-9047-a3cb61bf1089 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:39.548188 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-70772751-a16a-4228-9047-a3cb61bf1089 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:39.548934 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-70772751-a16a-4228-9047-a3cb61bf1089 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:39.549384 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-70772751-a16a-4228-9047-a3cb61bf1089 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:39.549680 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ff563fb1-35db-4ce0-bcef-cc20b538119f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:39.549816 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-70772751-a16a-4228-9047-a3cb61bf1089 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:39.551289 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ff563fb1-35db-4ce0-bcef-cc20b538119f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:39.552972 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-ff563fb1-35db-4ce0-bcef-cc20b538119f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1752 microversion: 2.20 time: 0.226685 Aug 18 14:54:39.553776 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 246/490] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:39 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1752 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:54:39.684212 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-70772751-a16a-4228-9047-a3cb61bf1089 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:39.692499 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-70772751-a16a-4228-9047-a3cb61bf1089 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.155375 Aug 18 14:54:39.693152 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 245/491] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:39 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:40.579816 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f681826d-547a-49f0-a4f6-ae870c631c6c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:40.581009 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f681826d-547a-49f0-a4f6-ae870c631c6c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:40.587366 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f681826d-547a-49f0-a4f6-ae870c631c6c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:40.587921 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f681826d-547a-49f0-a4f6-ae870c631c6c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:40.588356 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f681826d-547a-49f0-a4f6-ae870c631c6c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:40.589047 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f681826d-547a-49f0-a4f6-ae870c631c6c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:40.589500 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f681826d-547a-49f0-a4f6-ae870c631c6c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:40.589919 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f681826d-547a-49f0-a4f6-ae870c631c6c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:40.717624 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-c12f100d-c48a-4ded-b113-1bf423e414da tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:40.718242 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-c12f100d-c48a-4ded-b113-1bf423e414da tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:40.727613 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f681826d-547a-49f0-a4f6-ae870c631c6c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:40.734910 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c12f100d-c48a-4ded-b113-1bf423e414da tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:40.735330 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c12f100d-c48a-4ded-b113-1bf423e414da tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:40.737435 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f681826d-547a-49f0-a4f6-ae870c631c6c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:40.739046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f681826d-547a-49f0-a4f6-ae870c631c6c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:40.739221 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c12f100d-c48a-4ded-b113-1bf423e414da tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:40.739976 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c12f100d-c48a-4ded-b113-1bf423e414da tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:40.740434 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c12f100d-c48a-4ded-b113-1bf423e414da tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:40.740857 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-c12f100d-c48a-4ded-b113-1bf423e414da tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:40.741318 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f681826d-547a-49f0-a4f6-ae870c631c6c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1752 microversion: 2.20 time: 0.165393 Aug 18 14:54:40.742885 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 247/492] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:40 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:40.762810 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:54:40.880528 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-c12f100d-c48a-4ded-b113-1bf423e414da tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:40.889527 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-c12f100d-c48a-4ded-b113-1bf423e414da tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.179306 Aug 18 14:54:40.890204 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 246/493] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:40 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:41.263986 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-c523bdc8-0439-4f7c-8119-dd9d74f4c1f4 req-6a6d0b88-fd6a-412d-abb4-904da3cedc99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80e04f79-c52c-4c8e-be85-d3beb6146729", "tag": "f09381f7-1a30-4400-be85-bedf9e4caa60"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:54:41.273256 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-c523bdc8-0439-4f7c-8119-dd9d74f4c1f4 req-6a6d0b88-fd6a-412d-abb4-904da3cedc99 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:41.273736 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-c523bdc8-0439-4f7c-8119-dd9d74f4c1f4 req-6a6d0b88-fd6a-412d-abb4-904da3cedc99 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:41.274165 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-c523bdc8-0439-4f7c-8119-dd9d74f4c1f4 req-6a6d0b88-fd6a-412d-abb4-904da3cedc99 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:41.287063 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-c523bdc8-0439-4f7c-8119-dd9d74f4c1f4 req-6a6d0b88-fd6a-412d-abb4-904da3cedc99 service nova] Creating event network-changed:f09381f7-1a30-4400-be85-bedf9e4caa60 for instance 80e04f79-c52c-4c8e-be85-d3beb6146729 on hv-cinder-85220 Aug 18 14:54:41.292118 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-c523bdc8-0439-4f7c-8119-dd9d74f4c1f4 req-6a6d0b88-fd6a-412d-abb4-904da3cedc99 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031655 Aug 18 14:54:41.292740 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 248/494] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:54:41.764274 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-d206748b-f870-49fa-a08d-817646e92add tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:41.764971 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-d206748b-f870-49fa-a08d-817646e92add tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:41.771939 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d206748b-f870-49fa-a08d-817646e92add tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:41.772572 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d206748b-f870-49fa-a08d-817646e92add tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:41.773707 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d206748b-f870-49fa-a08d-817646e92add tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:41.774518 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d206748b-f870-49fa-a08d-817646e92add tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:41.774974 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d206748b-f870-49fa-a08d-817646e92add tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:41.775400 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-d206748b-f870-49fa-a08d-817646e92add tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:41.917126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-57fb9436-0a06-4375-81fd-75ba326f6d96 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:41.917932 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-57fb9436-0a06-4375-81fd-75ba326f6d96 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:41.936120 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57fb9436-0a06-4375-81fd-75ba326f6d96 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:41.936689 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57fb9436-0a06-4375-81fd-75ba326f6d96 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:41.937315 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57fb9436-0a06-4375-81fd-75ba326f6d96 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:41.938170 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57fb9436-0a06-4375-81fd-75ba326f6d96 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:41.938697 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57fb9436-0a06-4375-81fd-75ba326f6d96 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:41.940023 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57fb9436-0a06-4375-81fd-75ba326f6d96 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:41.955937 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-d206748b-f870-49fa-a08d-817646e92add tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:41.973113 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-d206748b-f870-49fa-a08d-817646e92add tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:41.977841 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-d206748b-f870-49fa-a08d-817646e92add tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:41.980025 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-d206748b-f870-49fa-a08d-817646e92add tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1752 microversion: 2.20 time: 0.219985 Aug 18 14:54:41.980607 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 247/495] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:41 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1752 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:42.153547 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-57fb9436-0a06-4375-81fd-75ba326f6d96 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:42.162594 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-57fb9436-0a06-4375-81fd-75ba326f6d96 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.251494 Aug 18 14:54:42.173188 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 249/496] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:41 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:54:43.004258 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-244f38c4-1a90-410a-addd-83a36bc07800 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:43.005025 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-244f38c4-1a90-410a-addd-83a36bc07800 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:43.011815 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-244f38c4-1a90-410a-addd-83a36bc07800 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:43.012356 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-244f38c4-1a90-410a-addd-83a36bc07800 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:43.012801 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-244f38c4-1a90-410a-addd-83a36bc07800 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:43.013510 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-244f38c4-1a90-410a-addd-83a36bc07800 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:43.013968 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-244f38c4-1a90-410a-addd-83a36bc07800 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:43.014395 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-244f38c4-1a90-410a-addd-83a36bc07800 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:43.154134 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-244f38c4-1a90-410a-addd-83a36bc07800 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:43.162920 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-244f38c4-1a90-410a-addd-83a36bc07800 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:43.164972 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-244f38c4-1a90-410a-addd-83a36bc07800 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:43.166141 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-244f38c4-1a90-410a-addd-83a36bc07800 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1752 microversion: 2.20 time: 0.165734 Aug 18 14:54:43.166702 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 248/497] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:42 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:43.184811 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-74686942-f5fb-44e9-9a19-3c12a8b5e7ec tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:43.185418 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-74686942-f5fb-44e9-9a19-3c12a8b5e7ec tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:43.193468 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74686942-f5fb-44e9-9a19-3c12a8b5e7ec tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:43.194050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74686942-f5fb-44e9-9a19-3c12a8b5e7ec tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:43.194479 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74686942-f5fb-44e9-9a19-3c12a8b5e7ec tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:43.195173 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74686942-f5fb-44e9-9a19-3c12a8b5e7ec tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:43.195621 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74686942-f5fb-44e9-9a19-3c12a8b5e7ec tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:43.196068 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74686942-f5fb-44e9-9a19-3c12a8b5e7ec tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:43.344565 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-74686942-f5fb-44e9-9a19-3c12a8b5e7ec tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:43.353183 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-74686942-f5fb-44e9-9a19-3c12a8b5e7ec tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.172268 Aug 18 14:54:43.353756 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 250/498] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:43 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:44.190146 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-1951de81-b10f-4808-b162-95bb50e5ba54 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:44.190748 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-1951de81-b10f-4808-b162-95bb50e5ba54 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:44.197975 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1951de81-b10f-4808-b162-95bb50e5ba54 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:44.198439 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1951de81-b10f-4808-b162-95bb50e5ba54 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:44.198863 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1951de81-b10f-4808-b162-95bb50e5ba54 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:44.199554 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1951de81-b10f-4808-b162-95bb50e5ba54 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:44.200028 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1951de81-b10f-4808-b162-95bb50e5ba54 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:44.200447 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1951de81-b10f-4808-b162-95bb50e5ba54 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:44.337749 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-1951de81-b10f-4808-b162-95bb50e5ba54 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:44.346688 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-1951de81-b10f-4808-b162-95bb50e5ba54 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:44.348211 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-1951de81-b10f-4808-b162-95bb50e5ba54 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:44.349379 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-1951de81-b10f-4808-b162-95bb50e5ba54 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1752 microversion: 2.20 time: 0.163110 Aug 18 14:54:44.349934 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 249/499] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:44 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:44.374050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-070cad40-b847-4128-b9cb-0feca4e8619c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:44.374599 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-070cad40-b847-4128-b9cb-0feca4e8619c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:44.381381 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-070cad40-b847-4128-b9cb-0feca4e8619c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:44.381864 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-070cad40-b847-4128-b9cb-0feca4e8619c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:44.382311 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-070cad40-b847-4128-b9cb-0feca4e8619c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:44.382985 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-070cad40-b847-4128-b9cb-0feca4e8619c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:44.383429 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-070cad40-b847-4128-b9cb-0feca4e8619c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:44.383902 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-070cad40-b847-4128-b9cb-0feca4e8619c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:44.524891 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-070cad40-b847-4128-b9cb-0feca4e8619c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:44.537769 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-070cad40-b847-4128-b9cb-0feca4e8619c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.167424 Aug 18 14:54:44.538346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 251/500] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:44 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:45.373263 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-ed0c6953-8b87-4ceb-913f-2acee65e9b63 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:45.373890 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-ed0c6953-8b87-4ceb-913f-2acee65e9b63 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:45.380676 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ed0c6953-8b87-4ceb-913f-2acee65e9b63 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:45.381177 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ed0c6953-8b87-4ceb-913f-2acee65e9b63 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:45.381609 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ed0c6953-8b87-4ceb-913f-2acee65e9b63 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:45.382867 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ed0c6953-8b87-4ceb-913f-2acee65e9b63 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:45.383328 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ed0c6953-8b87-4ceb-913f-2acee65e9b63 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:45.383804 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-ed0c6953-8b87-4ceb-913f-2acee65e9b63 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:45.519882 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-ed0c6953-8b87-4ceb-913f-2acee65e9b63 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:45.532186 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-ed0c6953-8b87-4ceb-913f-2acee65e9b63 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:45.533732 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-ed0c6953-8b87-4ceb-913f-2acee65e9b63 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:45.534930 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-ed0c6953-8b87-4ceb-913f-2acee65e9b63 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1752 microversion: 2.20 time: 0.165623 Aug 18 14:54:45.535483 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 250/501] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:45 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:45.560007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b7f3287b-f34f-438d-95eb-cedf17de877a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:45.560625 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b7f3287b-f34f-438d-95eb-cedf17de877a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:45.567541 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b7f3287b-f34f-438d-95eb-cedf17de877a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:45.568056 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b7f3287b-f34f-438d-95eb-cedf17de877a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:45.568482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b7f3287b-f34f-438d-95eb-cedf17de877a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:45.569175 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b7f3287b-f34f-438d-95eb-cedf17de877a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:45.569620 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b7f3287b-f34f-438d-95eb-cedf17de877a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:45.570811 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b7f3287b-f34f-438d-95eb-cedf17de877a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:45.714518 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b7f3287b-f34f-438d-95eb-cedf17de877a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:45.728938 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b7f3287b-f34f-438d-95eb-cedf17de877a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.172600 Aug 18 14:54:45.729450 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 252/502] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:45 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:46.558192 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-8e528aad-1362-4600-8a1d-fd7f6cc8d83d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:46.558801 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-8e528aad-1362-4600-8a1d-fd7f6cc8d83d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:46.565426 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8e528aad-1362-4600-8a1d-fd7f6cc8d83d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:46.565910 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8e528aad-1362-4600-8a1d-fd7f6cc8d83d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:46.566347 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8e528aad-1362-4600-8a1d-fd7f6cc8d83d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:46.567076 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8e528aad-1362-4600-8a1d-fd7f6cc8d83d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:46.567531 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8e528aad-1362-4600-8a1d-fd7f6cc8d83d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:46.567979 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-8e528aad-1362-4600-8a1d-fd7f6cc8d83d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:46.703408 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-8e528aad-1362-4600-8a1d-fd7f6cc8d83d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:46.712491 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-8e528aad-1362-4600-8a1d-fd7f6cc8d83d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:46.713954 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-8e528aad-1362-4600-8a1d-fd7f6cc8d83d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:46.715107 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-8e528aad-1362-4600-8a1d-fd7f6cc8d83d tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1752 microversion: 2.20 time: 0.161423 Aug 18 14:54:46.715669 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 251/503] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:46 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:46.750878 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-172baf17-f864-4b72-bc3a-93bdc970ab01 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:46.751493 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-172baf17-f864-4b72-bc3a-93bdc970ab01 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:46.758154 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-172baf17-f864-4b72-bc3a-93bdc970ab01 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:46.758641 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-172baf17-f864-4b72-bc3a-93bdc970ab01 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:46.759076 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-172baf17-f864-4b72-bc3a-93bdc970ab01 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:46.760071 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-172baf17-f864-4b72-bc3a-93bdc970ab01 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:46.760526 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-172baf17-f864-4b72-bc3a-93bdc970ab01 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:46.760947 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-172baf17-f864-4b72-bc3a-93bdc970ab01 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:46.898171 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-172baf17-f864-4b72-bc3a-93bdc970ab01 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:46.906149 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-172baf17-f864-4b72-bc3a-93bdc970ab01 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.159071 Aug 18 14:54:46.906730 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 253/504] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:46 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:47.738003 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-53577ffb-54bb-4d43-9ad6-f455894a0902 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:47.738639 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-53577ffb-54bb-4d43-9ad6-f455894a0902 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:47.746051 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-53577ffb-54bb-4d43-9ad6-f455894a0902 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:47.746559 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-53577ffb-54bb-4d43-9ad6-f455894a0902 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:47.747137 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-53577ffb-54bb-4d43-9ad6-f455894a0902 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:47.748001 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-53577ffb-54bb-4d43-9ad6-f455894a0902 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:47.748468 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-53577ffb-54bb-4d43-9ad6-f455894a0902 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:47.748896 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-53577ffb-54bb-4d43-9ad6-f455894a0902 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:47.892806 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-53577ffb-54bb-4d43-9ad6-f455894a0902 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:47.902475 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-53577ffb-54bb-4d43-9ad6-f455894a0902 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:47.904003 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-53577ffb-54bb-4d43-9ad6-f455894a0902 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:47.905205 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-53577ffb-54bb-4d43-9ad6-f455894a0902 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1808 microversion: 2.20 time: 0.171246 Aug 18 14:54:47.905769 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 252/505] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:47 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:47.927221 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2a0d38ee-939e-4b41-acd1-e187b497f18d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:47.927879 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2a0d38ee-939e-4b41-acd1-e187b497f18d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:47.934983 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2a0d38ee-939e-4b41-acd1-e187b497f18d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:47.935467 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2a0d38ee-939e-4b41-acd1-e187b497f18d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:47.935933 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2a0d38ee-939e-4b41-acd1-e187b497f18d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:47.936637 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2a0d38ee-939e-4b41-acd1-e187b497f18d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:47.937097 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2a0d38ee-939e-4b41-acd1-e187b497f18d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:47.937522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2a0d38ee-939e-4b41-acd1-e187b497f18d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:48.076245 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2a0d38ee-939e-4b41-acd1-e187b497f18d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:48.084380 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2a0d38ee-939e-4b41-acd1-e187b497f18d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.160822 Aug 18 14:54:48.085062 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 254/506] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:47 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:48.928013 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-e5fb11cb-2623-4144-a2a4-c20bccfdc428 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:48.928624 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-e5fb11cb-2623-4144-a2a4-c20bccfdc428 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:48.935265 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e5fb11cb-2623-4144-a2a4-c20bccfdc428 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:48.935783 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e5fb11cb-2623-4144-a2a4-c20bccfdc428 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:48.936217 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e5fb11cb-2623-4144-a2a4-c20bccfdc428 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:48.936921 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e5fb11cb-2623-4144-a2a4-c20bccfdc428 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:48.937373 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e5fb11cb-2623-4144-a2a4-c20bccfdc428 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:48.937793 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-e5fb11cb-2623-4144-a2a4-c20bccfdc428 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:49.076867 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-e5fb11cb-2623-4144-a2a4-c20bccfdc428 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:49.086360 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-e5fb11cb-2623-4144-a2a4-c20bccfdc428 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:49.087893 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-e5fb11cb-2623-4144-a2a4-c20bccfdc428 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:49.089043 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-e5fb11cb-2623-4144-a2a4-c20bccfdc428 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1808 microversion: 2.20 time: 0.165107 Aug 18 14:54:49.089622 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 253/507] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:48 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:49.107107 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-001509a1-cc67-44c5-be4f-f28fdb1d1704 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:49.107785 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-001509a1-cc67-44c5-be4f-f28fdb1d1704 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:49.114263 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-001509a1-cc67-44c5-be4f-f28fdb1d1704 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:49.114755 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-001509a1-cc67-44c5-be4f-f28fdb1d1704 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:49.115194 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-001509a1-cc67-44c5-be4f-f28fdb1d1704 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:49.115966 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-001509a1-cc67-44c5-be4f-f28fdb1d1704 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:49.116424 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-001509a1-cc67-44c5-be4f-f28fdb1d1704 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:49.117480 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-001509a1-cc67-44c5-be4f-f28fdb1d1704 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:49.251437 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-001509a1-cc67-44c5-be4f-f28fdb1d1704 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:49.260298 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-001509a1-cc67-44c5-be4f-f28fdb1d1704 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.160280 Aug 18 14:54:49.261073 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 255/508] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:49 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:50.112977 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-899bd961-e5b7-4878-ae0b-045efd47a7ad tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:50.113593 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-899bd961-e5b7-4878-ae0b-045efd47a7ad tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:50.120484 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-899bd961-e5b7-4878-ae0b-045efd47a7ad tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:50.120966 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-899bd961-e5b7-4878-ae0b-045efd47a7ad tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:50.121392 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-899bd961-e5b7-4878-ae0b-045efd47a7ad tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:50.122085 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-899bd961-e5b7-4878-ae0b-045efd47a7ad tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:50.122532 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-899bd961-e5b7-4878-ae0b-045efd47a7ad tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:50.122951 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-899bd961-e5b7-4878-ae0b-045efd47a7ad tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:50.257425 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-899bd961-e5b7-4878-ae0b-045efd47a7ad tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:50.266681 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-899bd961-e5b7-4878-ae0b-045efd47a7ad tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:50.268205 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-899bd961-e5b7-4878-ae0b-045efd47a7ad tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:50.269375 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-899bd961-e5b7-4878-ae0b-045efd47a7ad tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1808 microversion: 2.20 time: 0.160372 Aug 18 14:54:50.269928 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 254/509] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:50 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:50.281201 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e22ce0ac-04ac-4e5e-a837-0f3f84558cbe tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:50.281819 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e22ce0ac-04ac-4e5e-a837-0f3f84558cbe tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:50.288542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e22ce0ac-04ac-4e5e-a837-0f3f84558cbe tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:50.289537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e22ce0ac-04ac-4e5e-a837-0f3f84558cbe tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:50.289976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e22ce0ac-04ac-4e5e-a837-0f3f84558cbe tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:50.290688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e22ce0ac-04ac-4e5e-a837-0f3f84558cbe tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:50.291144 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e22ce0ac-04ac-4e5e-a837-0f3f84558cbe tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:50.291569 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e22ce0ac-04ac-4e5e-a837-0f3f84558cbe tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:50.430814 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e22ce0ac-04ac-4e5e-a837-0f3f84558cbe tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:50.438727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e22ce0ac-04ac-4e5e-a837-0f3f84558cbe tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.161350 Aug 18 14:54:50.439298 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 256/510] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:50 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:51.295856 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-1c2d5f15-b8f4-486d-a5eb-777d347f0bf2 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:51.296941 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-1c2d5f15-b8f4-486d-a5eb-777d347f0bf2 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:51.306031 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1c2d5f15-b8f4-486d-a5eb-777d347f0bf2 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:51.306515 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1c2d5f15-b8f4-486d-a5eb-777d347f0bf2 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:51.306945 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1c2d5f15-b8f4-486d-a5eb-777d347f0bf2 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:51.307641 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1c2d5f15-b8f4-486d-a5eb-777d347f0bf2 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:51.308147 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1c2d5f15-b8f4-486d-a5eb-777d347f0bf2 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:51.308567 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-1c2d5f15-b8f4-486d-a5eb-777d347f0bf2 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:51.450614 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-1c2d5f15-b8f4-486d-a5eb-777d347f0bf2 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:51.460129 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-1c2d5f15-b8f4-486d-a5eb-777d347f0bf2 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:51.462057 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2780da92-7623-4aa3-9c0c-222f69667898 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:51.462813 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-1c2d5f15-b8f4-486d-a5eb-777d347f0bf2 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:51.462998 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2780da92-7623-4aa3-9c0c-222f69667898 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:51.464432 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-1c2d5f15-b8f4-486d-a5eb-777d347f0bf2 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1808 microversion: 2.20 time: 0.175050 Aug 18 14:54:51.466220 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 255/511] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:51 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:51.486521 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2780da92-7623-4aa3-9c0c-222f69667898 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:51.487012 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2780da92-7623-4aa3-9c0c-222f69667898 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:51.487661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2780da92-7623-4aa3-9c0c-222f69667898 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:51.488605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2780da92-7623-4aa3-9c0c-222f69667898 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:51.489061 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2780da92-7623-4aa3-9c0c-222f69667898 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:51.489475 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2780da92-7623-4aa3-9c0c-222f69667898 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:51.629883 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2780da92-7623-4aa3-9c0c-222f69667898 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:51.632286 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:54:51.640562 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2780da92-7623-4aa3-9c0c-222f69667898 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.183229 Aug 18 14:54:51.641433 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 257/512] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:51 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:54:52.488278 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-42137160-15dd-42f2-a91b-221984acef92 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:52.488888 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-42137160-15dd-42f2-a91b-221984acef92 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:52.495553 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-42137160-15dd-42f2-a91b-221984acef92 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:52.496065 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-42137160-15dd-42f2-a91b-221984acef92 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:52.496494 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-42137160-15dd-42f2-a91b-221984acef92 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:52.497186 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-42137160-15dd-42f2-a91b-221984acef92 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:52.497631 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-42137160-15dd-42f2-a91b-221984acef92 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:52.498049 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-42137160-15dd-42f2-a91b-221984acef92 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:52.629980 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-42137160-15dd-42f2-a91b-221984acef92 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:52.639953 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-42137160-15dd-42f2-a91b-221984acef92 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:52.641424 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-42137160-15dd-42f2-a91b-221984acef92 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:52.642589 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-42137160-15dd-42f2-a91b-221984acef92 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1808 microversion: 2.20 time: 0.158230 Aug 18 14:54:52.643147 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 256/513] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:52 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:52.662605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-20a89c5e-54d2-4116-afbb-b01224fe494e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:52.663251 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-20a89c5e-54d2-4116-afbb-b01224fe494e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:52.670824 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-20a89c5e-54d2-4116-afbb-b01224fe494e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:52.671316 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-20a89c5e-54d2-4116-afbb-b01224fe494e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:52.671909 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-20a89c5e-54d2-4116-afbb-b01224fe494e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:52.672617 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-20a89c5e-54d2-4116-afbb-b01224fe494e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:52.673075 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-20a89c5e-54d2-4116-afbb-b01224fe494e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:52.673501 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-20a89c5e-54d2-4116-afbb-b01224fe494e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:52.857087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-20a89c5e-54d2-4116-afbb-b01224fe494e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:52.865042 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-20a89c5e-54d2-4116-afbb-b01224fe494e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.206594 Aug 18 14:54:52.866364 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 258/514] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:52 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:53.666417 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-2bdea335-5a37-4173-822f-8aebd1030cb5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:53.667273 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-2bdea335-5a37-4173-822f-8aebd1030cb5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:53.669366 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG dbcounter [-] [132267] Writing DB stats nova_api:SELECT=60 {{(pid=132267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:54:53.674709 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2bdea335-5a37-4173-822f-8aebd1030cb5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:53.675186 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2bdea335-5a37-4173-822f-8aebd1030cb5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:53.675615 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2bdea335-5a37-4173-822f-8aebd1030cb5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:53.676352 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2bdea335-5a37-4173-822f-8aebd1030cb5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:53.676796 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2bdea335-5a37-4173-822f-8aebd1030cb5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:53.677209 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-2bdea335-5a37-4173-822f-8aebd1030cb5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:53.821749 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-2bdea335-5a37-4173-822f-8aebd1030cb5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:53.831015 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-2bdea335-5a37-4173-822f-8aebd1030cb5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:53.832527 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-2bdea335-5a37-4173-822f-8aebd1030cb5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:53.833692 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-2bdea335-5a37-4173-822f-8aebd1030cb5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1808 microversion: 2.20 time: 0.172173 Aug 18 14:54:53.834816 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 257/515] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:53 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:53.886313 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c201694d-2d41-4df9-b76b-3e24a26007f2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:53.886928 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c201694d-2d41-4df9-b76b-3e24a26007f2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:53.893614 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c201694d-2d41-4df9-b76b-3e24a26007f2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:53.894095 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c201694d-2d41-4df9-b76b-3e24a26007f2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:53.894523 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c201694d-2d41-4df9-b76b-3e24a26007f2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:53.895214 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c201694d-2d41-4df9-b76b-3e24a26007f2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:53.895658 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c201694d-2d41-4df9-b76b-3e24a26007f2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:53.896101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c201694d-2d41-4df9-b76b-3e24a26007f2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:54.039041 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c201694d-2d41-4df9-b76b-3e24a26007f2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:54.048888 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c201694d-2d41-4df9-b76b-3e24a26007f2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.165859 Aug 18 14:54:54.048888 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 259/516] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:53 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:54.857835 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-5c6c71fd-d32a-403b-8285-907de88558b1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:54.858477 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-5c6c71fd-d32a-403b-8285-907de88558b1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:54.865335 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5c6c71fd-d32a-403b-8285-907de88558b1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:54.866026 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5c6c71fd-d32a-403b-8285-907de88558b1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:54.866709 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5c6c71fd-d32a-403b-8285-907de88558b1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:54.867661 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5c6c71fd-d32a-403b-8285-907de88558b1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:54.868371 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5c6c71fd-d32a-403b-8285-907de88558b1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:54.868878 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-5c6c71fd-d32a-403b-8285-907de88558b1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:55.072960 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ce54ae80-5a9c-4bb9-9127-95d96cdacf74 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:55.074591 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ce54ae80-5a9c-4bb9-9127-95d96cdacf74 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:55.098216 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ce54ae80-5a9c-4bb9-9127-95d96cdacf74 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:55.105242 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ce54ae80-5a9c-4bb9-9127-95d96cdacf74 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:55.108354 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ce54ae80-5a9c-4bb9-9127-95d96cdacf74 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:55.108811 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-5c6c71fd-d32a-403b-8285-907de88558b1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:55.109826 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ce54ae80-5a9c-4bb9-9127-95d96cdacf74 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:55.112602 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ce54ae80-5a9c-4bb9-9127-95d96cdacf74 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:55.113202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ce54ae80-5a9c-4bb9-9127-95d96cdacf74 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:55.122681 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-5c6c71fd-d32a-403b-8285-907de88558b1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:55.127964 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-5c6c71fd-d32a-403b-8285-907de88558b1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:55.129235 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-5c6c71fd-d32a-403b-8285-907de88558b1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1808 microversion: 2.20 time: 0.275373 Aug 18 14:54:55.129812 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 258/517] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:54 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1808 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:55.282529 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ce54ae80-5a9c-4bb9-9127-95d96cdacf74 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:55.291281 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-ce54ae80-5a9c-4bb9-9127-95d96cdacf74 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.225153 Aug 18 14:54:55.292452 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 260/518] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:55 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:56.155213 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-fbcd86a3-8cb9-4134-b3c8-2c8a65a0bec8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:56.156829 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-fbcd86a3-8cb9-4134-b3c8-2c8a65a0bec8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:56.164942 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fbcd86a3-8cb9-4134-b3c8-2c8a65a0bec8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:56.165441 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fbcd86a3-8cb9-4134-b3c8-2c8a65a0bec8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:56.165881 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fbcd86a3-8cb9-4134-b3c8-2c8a65a0bec8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:56.166599 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fbcd86a3-8cb9-4134-b3c8-2c8a65a0bec8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:56.167059 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fbcd86a3-8cb9-4134-b3c8-2c8a65a0bec8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:56.167484 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-fbcd86a3-8cb9-4134-b3c8-2c8a65a0bec8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:56.312997 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b71f3749-baf4-4d40-8297-cbbb65c49e33 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:56.314278 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b71f3749-baf4-4d40-8297-cbbb65c49e33 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:56.316999 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-fbcd86a3-8cb9-4134-b3c8-2c8a65a0bec8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:56.322204 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b71f3749-baf4-4d40-8297-cbbb65c49e33 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:56.322702 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b71f3749-baf4-4d40-8297-cbbb65c49e33 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:56.323131 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b71f3749-baf4-4d40-8297-cbbb65c49e33 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:56.323951 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b71f3749-baf4-4d40-8297-cbbb65c49e33 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:56.324407 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b71f3749-baf4-4d40-8297-cbbb65c49e33 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:56.324832 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b71f3749-baf4-4d40-8297-cbbb65c49e33 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:56.328752 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-fbcd86a3-8cb9-4134-b3c8-2c8a65a0bec8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:56.332157 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-fbcd86a3-8cb9-4134-b3c8-2c8a65a0bec8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:56.333758 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-fbcd86a3-8cb9-4134-b3c8-2c8a65a0bec8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1808 microversion: 2.20 time: 0.182749 Aug 18 14:54:56.351438 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 259/519] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:56 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:56.504056 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b71f3749-baf4-4d40-8297-cbbb65c49e33 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:56.513716 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b71f3749-baf4-4d40-8297-cbbb65c49e33 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.204827 Aug 18 14:54:56.517118 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 261/520] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:56 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:54:57.357162 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-559cb769-dd6c-44a5-849a-3e21943712a0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:57.358026 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-559cb769-dd6c-44a5-849a-3e21943712a0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:57.364989 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-559cb769-dd6c-44a5-849a-3e21943712a0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:57.365652 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-559cb769-dd6c-44a5-849a-3e21943712a0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:57.366235 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-559cb769-dd6c-44a5-849a-3e21943712a0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:57.367065 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-559cb769-dd6c-44a5-849a-3e21943712a0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:57.367584 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-559cb769-dd6c-44a5-849a-3e21943712a0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:57.368094 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-559cb769-dd6c-44a5-849a-3e21943712a0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:57.504452 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-559cb769-dd6c-44a5-849a-3e21943712a0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:57.513965 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-559cb769-dd6c-44a5-849a-3e21943712a0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:57.515450 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-559cb769-dd6c-44a5-849a-3e21943712a0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:57.516637 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-559cb769-dd6c-44a5-849a-3e21943712a0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1808 microversion: 2.20 time: 0.163523 Aug 18 14:54:57.517353 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 260/521] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:57 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:57.544201 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-395f7090-386a-48f9-8b13-9fb97695cee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:57.544804 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-395f7090-386a-48f9-8b13-9fb97695cee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:57.568648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-395f7090-386a-48f9-8b13-9fb97695cee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:57.569136 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-395f7090-386a-48f9-8b13-9fb97695cee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:57.569635 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-395f7090-386a-48f9-8b13-9fb97695cee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:57.570351 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-395f7090-386a-48f9-8b13-9fb97695cee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:57.570805 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-395f7090-386a-48f9-8b13-9fb97695cee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:57.571224 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-395f7090-386a-48f9-8b13-9fb97695cee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:57.720883 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-395f7090-386a-48f9-8b13-9fb97695cee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:57.729801 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-395f7090-386a-48f9-8b13-9fb97695cee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.190471 Aug 18 14:54:57.730376 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 262/522] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:57 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:58.545903 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-aaa5ccb9-c871-4954-b375-5f94942ee30c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:58.546526 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-aaa5ccb9-c871-4954-b375-5f94942ee30c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:58.553633 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-aaa5ccb9-c871-4954-b375-5f94942ee30c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:58.554633 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-aaa5ccb9-c871-4954-b375-5f94942ee30c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:58.555155 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-aaa5ccb9-c871-4954-b375-5f94942ee30c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:58.555904 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-aaa5ccb9-c871-4954-b375-5f94942ee30c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:58.556366 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-aaa5ccb9-c871-4954-b375-5f94942ee30c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:58.556792 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-aaa5ccb9-c871-4954-b375-5f94942ee30c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:58.709263 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-aaa5ccb9-c871-4954-b375-5f94942ee30c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:58.718836 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-aaa5ccb9-c871-4954-b375-5f94942ee30c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:58.720388 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-aaa5ccb9-c871-4954-b375-5f94942ee30c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:58.721580 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-aaa5ccb9-c871-4954-b375-5f94942ee30c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1808 microversion: 2.20 time: 0.179707 Aug 18 14:54:58.722150 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 261/523] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:58 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:58.750332 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c50f444e-38f2-4699-8c37-abf961e53784 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:58.750934 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c50f444e-38f2-4699-8c37-abf961e53784 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:58.757199 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c50f444e-38f2-4699-8c37-abf961e53784 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:58.757675 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c50f444e-38f2-4699-8c37-abf961e53784 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:58.758103 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c50f444e-38f2-4699-8c37-abf961e53784 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:58.758780 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c50f444e-38f2-4699-8c37-abf961e53784 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:58.759225 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c50f444e-38f2-4699-8c37-abf961e53784 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:58.759922 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c50f444e-38f2-4699-8c37-abf961e53784 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:58.899920 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c50f444e-38f2-4699-8c37-abf961e53784 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:58.909565 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c50f444e-38f2-4699-8c37-abf961e53784 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.162887 Aug 18 14:54:58.910739 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 263/524] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:58 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:54:59.745344 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.api.openstack.wsgi [None req-0c802d9d-94e3-4f7e-8d36-5838d1ff2633 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:59.746583 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.compute.api [None req-0c802d9d-94e3-4f7e-8d36-5838d1ff2633 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:59.754333 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0c802d9d-94e3-4f7e-8d36-5838d1ff2633 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:59.754757 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0c802d9d-94e3-4f7e-8d36-5838d1ff2633 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:59.755421 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0c802d9d-94e3-4f7e-8d36-5838d1ff2633 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:59.756222 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0c802d9d-94e3-4f7e-8d36-5838d1ff2633 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:59.756791 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0c802d9d-94e3-4f7e-8d36-5838d1ff2633 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:59.757720 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG oslo_concurrency.lockutils [None req-0c802d9d-94e3-4f7e-8d36-5838d1ff2633 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:59.899122 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-0c802d9d-94e3-4f7e-8d36-5838d1ff2633 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:59.910714 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-0c802d9d-94e3-4f7e-8d36-5838d1ff2633 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:59.912251 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: DEBUG nova.policy [None req-0c802d9d-94e3-4f7e-8d36-5838d1ff2633 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:54:59.914102 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO nova.api.openstack.requestlog [None req-0c802d9d-94e3-4f7e-8d36-5838d1ff2633 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1808 microversion: 2.20 time: 0.172260 Aug 18 14:54:59.914676 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: [pid: 132267|app: 0|req: 262/525] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:54:59 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:54:59.931135 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2c1b116d-5ab6-425b-a2e7-94c078d61c8d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:54:59.931936 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2c1b116d-5ab6-425b-a2e7-94c078d61c8d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:54:59.938578 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2c1b116d-5ab6-425b-a2e7-94c078d61c8d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:59.939065 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2c1b116d-5ab6-425b-a2e7-94c078d61c8d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:59.939497 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2c1b116d-5ab6-425b-a2e7-94c078d61c8d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:54:59.940265 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2c1b116d-5ab6-425b-a2e7-94c078d61c8d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:54:59.940715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2c1b116d-5ab6-425b-a2e7-94c078d61c8d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:54:59.941134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2c1b116d-5ab6-425b-a2e7-94c078d61c8d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:00.083043 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2c1b116d-5ab6-425b-a2e7-94c078d61c8d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:00.091713 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2c1b116d-5ab6-425b-a2e7-94c078d61c8d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.164381 Aug 18 14:55:00.105371 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 264/526] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:54:59 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:00.933418 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 14:55:00.942766 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Thu Aug 18 14:55:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 (ip 10.222.0.36) !!! Aug 18 14:55:01.116004 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2fff62b8-977a-492a-bab6-2e4fff9165fc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:01.117106 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2fff62b8-977a-492a-bab6-2e4fff9165fc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:01.124729 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2fff62b8-977a-492a-bab6-2e4fff9165fc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:01.125202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2fff62b8-977a-492a-bab6-2e4fff9165fc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:01.125861 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2fff62b8-977a-492a-bab6-2e4fff9165fc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:01.126571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2fff62b8-977a-492a-bab6-2e4fff9165fc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:01.127021 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2fff62b8-977a-492a-bab6-2e4fff9165fc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:01.127437 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2fff62b8-977a-492a-bab6-2e4fff9165fc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:01.292777 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2fff62b8-977a-492a-bab6-2e4fff9165fc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:01.302146 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2fff62b8-977a-492a-bab6-2e4fff9165fc tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.192322 Aug 18 14:55:01.302146 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 265/527] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:01 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:02.326414 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-237b1ca7-ef33-4e9b-81bb-bb09ee5bf164 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:02.332963 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-237b1ca7-ef33-4e9b-81bb-bb09ee5bf164 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:02.337078 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-237b1ca7-ef33-4e9b-81bb-bb09ee5bf164 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:02.337581 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-237b1ca7-ef33-4e9b-81bb-bb09ee5bf164 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:02.338017 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-237b1ca7-ef33-4e9b-81bb-bb09ee5bf164 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:02.338737 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-237b1ca7-ef33-4e9b-81bb-bb09ee5bf164 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:02.339195 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-237b1ca7-ef33-4e9b-81bb-bb09ee5bf164 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:02.339650 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-237b1ca7-ef33-4e9b-81bb-bb09ee5bf164 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:02.519389 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-237b1ca7-ef33-4e9b-81bb-bb09ee5bf164 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:02.546645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-237b1ca7-ef33-4e9b-81bb-bb09ee5bf164 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.227000 Aug 18 14:55:02.547475 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 266/528] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:02 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:03.575656 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-4f1ae940-ed0f-47d3-b83b-9f907b679700 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:03.577027 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-4f1ae940-ed0f-47d3-b83b-9f907b679700 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:03.593223 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4f1ae940-ed0f-47d3-b83b-9f907b679700 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:03.593895 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4f1ae940-ed0f-47d3-b83b-9f907b679700 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:03.595136 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4f1ae940-ed0f-47d3-b83b-9f907b679700 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:03.596170 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4f1ae940-ed0f-47d3-b83b-9f907b679700 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:03.622158 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4f1ae940-ed0f-47d3-b83b-9f907b679700 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:03.624243 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4f1ae940-ed0f-47d3-b83b-9f907b679700 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:03.833334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-4f1ae940-ed0f-47d3-b83b-9f907b679700 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:03.846556 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-4f1ae940-ed0f-47d3-b83b-9f907b679700 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.277663 Aug 18 14:55:03.847634 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 267/529] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:03 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:04.878237 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-08303009-a16b-4f10-ba5d-caeea2ba6c87 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:04.878964 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-08303009-a16b-4f10-ba5d-caeea2ba6c87 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:04.881565 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:55:04.888591 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-08303009-a16b-4f10-ba5d-caeea2ba6c87 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:04.888987 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-08303009-a16b-4f10-ba5d-caeea2ba6c87 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:04.889426 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-08303009-a16b-4f10-ba5d-caeea2ba6c87 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:04.896124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-08303009-a16b-4f10-ba5d-caeea2ba6c87 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:04.896837 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-08303009-a16b-4f10-ba5d-caeea2ba6c87 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:04.897497 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-08303009-a16b-4f10-ba5d-caeea2ba6c87 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:05.036835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-08303009-a16b-4f10-ba5d-caeea2ba6c87 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:05.044677 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-08303009-a16b-4f10-ba5d-caeea2ba6c87 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.170544 Aug 18 14:55:05.045246 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 268/530] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:04 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:06.066110 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-484099de-aebf-4946-8f07-2c81159ce1cf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:06.066772 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-484099de-aebf-4946-8f07-2c81159ce1cf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:06.073948 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-484099de-aebf-4946-8f07-2c81159ce1cf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:06.074441 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-484099de-aebf-4946-8f07-2c81159ce1cf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:06.074869 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-484099de-aebf-4946-8f07-2c81159ce1cf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:06.075555 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-484099de-aebf-4946-8f07-2c81159ce1cf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:06.076032 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-484099de-aebf-4946-8f07-2c81159ce1cf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:06.076452 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-484099de-aebf-4946-8f07-2c81159ce1cf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:06.210976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-484099de-aebf-4946-8f07-2c81159ce1cf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:06.218941 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-484099de-aebf-4946-8f07-2c81159ce1cf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.156669 Aug 18 14:55:06.219874 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 269/531] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:06 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:07.054899 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-4b041e02-e734-4b6c-a2cb-3c59dd224d3b tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:07.055392 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-4b041e02-e734-4b6c-a2cb-3c59dd224d3b tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: e198b9cf-f1a2-4568-831d-201df30f8dec] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:07.061450 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4b041e02-e734-4b6c-a2cb-3c59dd224d3b tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:07.061933 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4b041e02-e734-4b6c-a2cb-3c59dd224d3b tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:07.062366 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4b041e02-e734-4b6c-a2cb-3c59dd224d3b tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:07.063050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4b041e02-e734-4b6c-a2cb-3c59dd224d3b tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:07.063498 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4b041e02-e734-4b6c-a2cb-3c59dd224d3b tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:07.063957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4b041e02-e734-4b6c-a2cb-3c59dd224d3b tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:07.191417 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.objects.instance [None req-4b041e02-e734-4b6c-a2cb-3c59dd224d3b tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lazy-loading 'services' on Instance uuid e198b9cf-f1a2-4568-831d-201df30f8dec {{(pid=132268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:55:07.311985 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-4b041e02-e734-4b6c-a2cb-3c59dd224d3b tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec/os-volume_attachments/f28f46bf-9b3f-4d46-a63b-e47f0194d688" status: 202 len: 0 microversion: 2.1 time: 0.261484 Aug 18 14:55:07.312579 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 270/532] 10.222.0.36 () {58 vars in 1416 bytes} [Thu Aug 18 14:55:07 2022] DELETE /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec/os-volume_attachments/f28f46bf-9b3f-4d46-a63b-e47f0194d688 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 14:55:07.317790 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-74c8d09e-80bd-4d26-bb7e-e6fdee990abd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:07.318506 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-74c8d09e-80bd-4d26-bb7e-e6fdee990abd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:07.324919 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74c8d09e-80bd-4d26-bb7e-e6fdee990abd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:07.325399 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74c8d09e-80bd-4d26-bb7e-e6fdee990abd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:07.325829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74c8d09e-80bd-4d26-bb7e-e6fdee990abd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:07.326529 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74c8d09e-80bd-4d26-bb7e-e6fdee990abd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:07.326980 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74c8d09e-80bd-4d26-bb7e-e6fdee990abd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:07.327402 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74c8d09e-80bd-4d26-bb7e-e6fdee990abd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:07.467057 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-74c8d09e-80bd-4d26-bb7e-e6fdee990abd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:07.474860 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-74c8d09e-80bd-4d26-bb7e-e6fdee990abd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.161071 Aug 18 14:55:07.475425 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 271/533] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:07 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:08.496454 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-9afb7b6c-f7af-4b0a-8406-20d0e73a15a6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:08.497088 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-9afb7b6c-f7af-4b0a-8406-20d0e73a15a6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:08.503464 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9afb7b6c-f7af-4b0a-8406-20d0e73a15a6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:08.503976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9afb7b6c-f7af-4b0a-8406-20d0e73a15a6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:08.504411 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9afb7b6c-f7af-4b0a-8406-20d0e73a15a6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:08.505090 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9afb7b6c-f7af-4b0a-8406-20d0e73a15a6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:08.505540 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9afb7b6c-f7af-4b0a-8406-20d0e73a15a6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:08.505959 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9afb7b6c-f7af-4b0a-8406-20d0e73a15a6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:08.638235 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-9afb7b6c-f7af-4b0a-8406-20d0e73a15a6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:08.646406 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-9afb7b6c-f7af-4b0a-8406-20d0e73a15a6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.153748 Aug 18 14:55:08.646901 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 272/534] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:08 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:09.666343 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-561df967-38e4-4a93-ac0e-74de827dc84c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:09.667036 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-561df967-38e4-4a93-ac0e-74de827dc84c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:09.673489 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-561df967-38e4-4a93-ac0e-74de827dc84c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:09.673998 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-561df967-38e4-4a93-ac0e-74de827dc84c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:09.674433 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-561df967-38e4-4a93-ac0e-74de827dc84c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:09.675120 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-561df967-38e4-4a93-ac0e-74de827dc84c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:09.675571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-561df967-38e4-4a93-ac0e-74de827dc84c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:09.676018 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-561df967-38e4-4a93-ac0e-74de827dc84c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:09.809721 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-561df967-38e4-4a93-ac0e-74de827dc84c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:09.812108 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:55:09.820229 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-561df967-38e4-4a93-ac0e-74de827dc84c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1501 microversion: 2.1 time: 0.157081 Aug 18 14:55:09.820802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 273/535] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:09 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:09.840888 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-86b239ee-695e-4383-b10d-837d43bd396a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0667dbb6-26a6-4582-bbe7-65f8cfdc25e7"}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:55:09.843297 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-86b239ee-695e-4383-b10d-837d43bd396a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:09.849602 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-86b239ee-695e-4383-b10d-837d43bd396a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:09.850088 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-86b239ee-695e-4383-b10d-837d43bd396a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:09.851025 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-86b239ee-695e-4383-b10d-837d43bd396a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:09.851880 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-86b239ee-695e-4383-b10d-837d43bd396a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:09.852195 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-86b239ee-695e-4383-b10d-837d43bd396a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:09.852616 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-86b239ee-695e-4383-b10d-837d43bd396a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:09.876906 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-86b239ee-695e-4383-b10d-837d43bd396a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] HTTP exception thrown: Cannot 'attach_volume' instance 15c8904a-619f-4137-9ab6-6231d51327db while it is in vm_state rescued Aug 18 14:55:09.879113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-86b239ee-695e-4383-b10d-837d43bd396a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Request method failure captured: Aug 18 14:55:09.879113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: POST /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db/os-volume_attachments HTTP/1.1 Aug 18 14:55:09.879113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:55:09.879113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:55:09.879113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:55:09.879113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 74 Aug 18 14:55:09.879113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:55:09.879113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:55:09.879113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:55:09.879113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:55:09.879113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lJQwK2c115bNCfI9_4SFNLkllfgSZr5El1eNqitr3OQtjGAEW-PK-gbdLreyn40k786Z-SK2YhgyrUV5WJGnNRJIEHwtBu_7UfQYOE30KQE3ki2AOXsYaAaQyEq_0p9RnrNtYTZZ5VHW9FG03qMbGgeDDQs-wc6W0Yv5SdnYB7CjZs Aug 18 14:55:09.879113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:55:09.879113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:55:09.879113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:55:09.879113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:55:09.879113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:55:09.879113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:55:09.879113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: acc902aa109c4d7291c0bab62f80048e Aug 18 14:55:09.879113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1560225051 Aug 18 14:55:09.879113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:55:09.879113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:55:09.880757 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/acc902aa109c4d7291c0bab62f80048e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/acc902aa109c4d7291c0bab62f80048e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_acc902aa109c4d7291c0bab62f80048e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/acc902aa109c4d7291c0bab62f80048e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:55:09.880757 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1560225051 Aug 18 14:55:09.880757 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: acc902aa109c4d7291c0bab62f80048e Aug 18 14:55:09.880757 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1560225051 Aug 18 14:55:09.880757 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-ServerRescueNegativeTestJSON-1560225051-project Aug 18 14:55:09.880757 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:55:09.880757 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:55:09.880757 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 26eaa7f102bd41028983458ae48ff992 Aug 18 14:55:09.880757 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1560225051-project Aug 18 14:55:09.880757 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Aug 18 14:55:09.880757 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {"volumeAttachment": {"volumeId": "0667dbb6-26a6-4582-bbe7-65f8cfdc25e7"}} Aug 18 14:55:09.880757 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:55:09.881889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Cannot 'attach_volume' instance 15c8904a-619f-4137-9ab6-6231d51327db while it is in vm_state rescued Aug 18 14:55:09.881889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'server_id': '15c8904a-619f-4137-9ab6-6231d51327db', 'body': {'volumeAttachment': {'volumeId': '0667dbb6-26a6-4582-bbe7-65f8cfdc25e7'}}} Aug 18 14:55:09.881889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:55:09.881889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:55:09.881889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 18 14:55:09.881889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 18 14:55:09.881889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 14:55:09.881889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 14:55:09.881889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 14:55:09.881889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 14:55:09.881889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 15c8904a-619f-4137-9ab6-6231d51327db in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 18 14:55:09.881889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:55:09.881889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:55:09.881889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:55:09.881889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:55:09.881889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:55:09.881889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:55:09.881889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:55:09.881889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:55:09.883257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:55:09.883257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:55:09.883257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 14:55:09.883257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 14:55:09.883257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 14:55:09.883257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 14:55:09.883257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 14:55:09.883257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 14:55:09.883257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 18 14:55:09.883257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 14:55:09.883257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 14:55:09.883257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 14:55:09.883257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 15c8904a-619f-4137-9ab6-6231d51327db while it is in vm_state rescued Aug 18 14:55:09.883257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:55:09.883257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:55:09.883257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:55:09.883257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:55:09.883257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:55:09.883257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:55:09.885101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:55:09.885101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:55:09.885101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 15c8904a-619f-4137-9ab6-6231d51327db while it is in vm_state rescued Aug 18 14:55:09.885101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:55:09.885101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-86b239ee-695e-4383-b10d-837d43bd396a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Returning 409 to user: Cannot 'attach_volume' instance 15c8904a-619f-4137-9ab6-6231d51327db while it is in vm_state rescued {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:55:09.885101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-86b239ee-695e-4383-b10d-837d43bd396a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "POST /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044083 Aug 18 14:55:09.885101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 274/536] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Aug 18 14:55:09 2022] POST /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 18 14:55:09.889959 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-741ff707-113b-417a-b3d0-60b67ef3633b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:55:09.890488 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-741ff707-113b-417a-b3d0-60b67ef3633b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:09.896583 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-741ff707-113b-417a-b3d0-60b67ef3633b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:09.897075 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-741ff707-113b-417a-b3d0-60b67ef3633b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:09.897508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-741ff707-113b-417a-b3d0-60b67ef3633b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:09.898208 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-741ff707-113b-417a-b3d0-60b67ef3633b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:09.898660 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-741ff707-113b-417a-b3d0-60b67ef3633b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:09.899081 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-741ff707-113b-417a-b3d0-60b67ef3633b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:09.966111 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-741ff707-113b-417a-b3d0-60b67ef3633b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "POST /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db/action" status: 202 len: 0 microversion: 2.1 time: 0.080137 Aug 18 14:55:09.969776 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 275/537] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Aug 18 14:55:09 2022] POST /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 14:55:09.975257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-4cd99a7f-ad8c-4210-979f-d9caf789e92e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:09.976505 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-4cd99a7f-ad8c-4210-979f-d9caf789e92e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:09.982639 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4cd99a7f-ad8c-4210-979f-d9caf789e92e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:09.983087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4cd99a7f-ad8c-4210-979f-d9caf789e92e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:09.983522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4cd99a7f-ad8c-4210-979f-d9caf789e92e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:09.984240 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4cd99a7f-ad8c-4210-979f-d9caf789e92e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:09.984693 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4cd99a7f-ad8c-4210-979f-d9caf789e92e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:09.985146 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4cd99a7f-ad8c-4210-979f-d9caf789e92e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:10.172955 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-4cd99a7f-ad8c-4210-979f-d9caf789e92e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:10.181361 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-4cd99a7f-ad8c-4210-979f-d9caf789e92e tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1509 microversion: 2.1 time: 0.210030 Aug 18 14:55:10.181915 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 276/538] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:09 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1509 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:10.563986 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-abff2f0e-c8e8-4633-9ec8-618283b917b9 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:10.564498 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-abff2f0e-c8e8-4633-9ec8-618283b917b9 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: e198b9cf-f1a2-4568-831d-201df30f8dec] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:10.571006 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-abff2f0e-c8e8-4633-9ec8-618283b917b9 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:10.571488 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-abff2f0e-c8e8-4633-9ec8-618283b917b9 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:10.571946 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-abff2f0e-c8e8-4633-9ec8-618283b917b9 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:10.572642 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-abff2f0e-c8e8-4633-9ec8-618283b917b9 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:10.573099 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-abff2f0e-c8e8-4633-9ec8-618283b917b9 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:10.573525 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-abff2f0e-c8e8-4633-9ec8-618283b917b9 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:10.598679 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-abff2f0e-c8e8-4633-9ec8-618283b917b9 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: e198b9cf-f1a2-4568-831d-201df30f8dec] Going to try to terminate instance {{(pid=132268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:55:10.674907 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-abff2f0e-c8e8-4633-9ec8-618283b917b9 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec" status: 204 len: 0 microversion: 2.1 time: 0.115018 Aug 18 14:55:10.675561 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 277/539] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 14:55:10 2022] DELETE /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 14:55:10.684015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c9cccb63-3c82-46bc-a5ba-8517e2cb968d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:10.684732 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c9cccb63-3c82-46bc-a5ba-8517e2cb968d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: e198b9cf-f1a2-4568-831d-201df30f8dec] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:10.690378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c9cccb63-3c82-46bc-a5ba-8517e2cb968d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:10.690864 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c9cccb63-3c82-46bc-a5ba-8517e2cb968d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:10.691304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c9cccb63-3c82-46bc-a5ba-8517e2cb968d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:10.692034 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c9cccb63-3c82-46bc-a5ba-8517e2cb968d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:10.692491 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c9cccb63-3c82-46bc-a5ba-8517e2cb968d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:10.692916 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c9cccb63-3c82-46bc-a5ba-8517e2cb968d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:10.825273 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c9cccb63-3c82-46bc-a5ba-8517e2cb968d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:10.833025 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c9cccb63-3c82-46bc-a5ba-8517e2cb968d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec" status: 200 len: 1514 microversion: 2.1 time: 0.153188 Aug 18 14:55:10.833585 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 278/540] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:10 2022] GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:11.202341 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f9f7b56d-f109-4833-bcce-caf46f75e0c3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:11.202963 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f9f7b56d-f109-4833-bcce-caf46f75e0c3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:11.208994 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f9f7b56d-f109-4833-bcce-caf46f75e0c3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:11.209477 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f9f7b56d-f109-4833-bcce-caf46f75e0c3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:11.210417 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f9f7b56d-f109-4833-bcce-caf46f75e0c3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:11.211108 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f9f7b56d-f109-4833-bcce-caf46f75e0c3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:11.211565 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f9f7b56d-f109-4833-bcce-caf46f75e0c3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:11.212015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f9f7b56d-f109-4833-bcce-caf46f75e0c3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:11.337469 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f9f7b56d-f109-4833-bcce-caf46f75e0c3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:11.345176 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f9f7b56d-f109-4833-bcce-caf46f75e0c3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1509 microversion: 2.1 time: 0.146647 Aug 18 14:55:11.345744 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 279/541] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:11 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:11.854350 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3334eac6-0a7d-43d0-9ea7-661be4e99c52 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:11.854995 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-3334eac6-0a7d-43d0-9ea7-661be4e99c52 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: e198b9cf-f1a2-4568-831d-201df30f8dec] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:11.861666 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3334eac6-0a7d-43d0-9ea7-661be4e99c52 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:11.862143 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3334eac6-0a7d-43d0-9ea7-661be4e99c52 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:11.862568 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3334eac6-0a7d-43d0-9ea7-661be4e99c52 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:11.863242 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3334eac6-0a7d-43d0-9ea7-661be4e99c52 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:11.863699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3334eac6-0a7d-43d0-9ea7-661be4e99c52 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:11.864121 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3334eac6-0a7d-43d0-9ea7-661be4e99c52 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:11.993800 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-3334eac6-0a7d-43d0-9ea7-661be4e99c52 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:12.001464 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-3334eac6-0a7d-43d0-9ea7-661be4e99c52 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec" status: 200 len: 1514 microversion: 2.1 time: 0.150921 Aug 18 14:55:12.002014 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 280/542] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:11 2022] GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:12.365886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f89ac0cf-b59d-4063-9bb4-c6fd69266d0d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:12.366530 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f89ac0cf-b59d-4063-9bb4-c6fd69266d0d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:12.372461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f89ac0cf-b59d-4063-9bb4-c6fd69266d0d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:12.372936 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f89ac0cf-b59d-4063-9bb4-c6fd69266d0d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:12.373362 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f89ac0cf-b59d-4063-9bb4-c6fd69266d0d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:12.374043 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f89ac0cf-b59d-4063-9bb4-c6fd69266d0d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:12.374488 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f89ac0cf-b59d-4063-9bb4-c6fd69266d0d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:12.374904 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f89ac0cf-b59d-4063-9bb4-c6fd69266d0d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:12.506647 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f89ac0cf-b59d-4063-9bb4-c6fd69266d0d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:12.515024 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f89ac0cf-b59d-4063-9bb4-c6fd69266d0d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1509 microversion: 2.1 time: 0.152949 Aug 18 14:55:12.515582 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 281/543] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:12 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:13.022987 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-23aed2e3-cf36-4833-80ef-cfde7933cadc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:13.023662 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-23aed2e3-cf36-4833-80ef-cfde7933cadc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: e198b9cf-f1a2-4568-831d-201df30f8dec] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:13.030055 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-23aed2e3-cf36-4833-80ef-cfde7933cadc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:13.030527 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-23aed2e3-cf36-4833-80ef-cfde7933cadc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:13.030955 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-23aed2e3-cf36-4833-80ef-cfde7933cadc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:13.031630 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-23aed2e3-cf36-4833-80ef-cfde7933cadc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:13.032105 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-23aed2e3-cf36-4833-80ef-cfde7933cadc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:13.032551 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-23aed2e3-cf36-4833-80ef-cfde7933cadc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:13.163453 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-23aed2e3-cf36-4833-80ef-cfde7933cadc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:13.171140 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-23aed2e3-cf36-4833-80ef-cfde7933cadc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec" status: 200 len: 1514 microversion: 2.1 time: 0.152365 Aug 18 14:55:13.171711 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 282/544] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:13 2022] GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:13.535612 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e4692c99-2d11-4d0d-a985-66ad2a0755be tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:13.536834 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e4692c99-2d11-4d0d-a985-66ad2a0755be tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:13.543972 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e4692c99-2d11-4d0d-a985-66ad2a0755be tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:13.544456 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e4692c99-2d11-4d0d-a985-66ad2a0755be tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:13.544889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e4692c99-2d11-4d0d-a985-66ad2a0755be tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:13.545572 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e4692c99-2d11-4d0d-a985-66ad2a0755be tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:13.546025 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e4692c99-2d11-4d0d-a985-66ad2a0755be tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:13.546446 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e4692c99-2d11-4d0d-a985-66ad2a0755be tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:13.669906 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e4692c99-2d11-4d0d-a985-66ad2a0755be tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:13.677549 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e4692c99-2d11-4d0d-a985-66ad2a0755be tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1509 microversion: 2.1 time: 0.145769 Aug 18 14:55:13.678108 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 283/545] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:13 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1509 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:14.193270 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a42045ea-4281-4ae1-acd6-208204e38860 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:14.193910 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a42045ea-4281-4ae1-acd6-208204e38860 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: e198b9cf-f1a2-4568-831d-201df30f8dec] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:14.200351 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a42045ea-4281-4ae1-acd6-208204e38860 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:14.200830 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a42045ea-4281-4ae1-acd6-208204e38860 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:14.201264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a42045ea-4281-4ae1-acd6-208204e38860 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:14.201955 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a42045ea-4281-4ae1-acd6-208204e38860 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:14.202412 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a42045ea-4281-4ae1-acd6-208204e38860 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:14.202837 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a42045ea-4281-4ae1-acd6-208204e38860 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:14.332053 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a42045ea-4281-4ae1-acd6-208204e38860 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:14.342154 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a42045ea-4281-4ae1-acd6-208204e38860 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec" status: 200 len: 1514 microversion: 2.1 time: 0.153403 Aug 18 14:55:14.342893 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 284/546] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:14 2022] GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:14.698970 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f09d7a8e-4d77-468f-95a9-e10b55fe8bba tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:14.699604 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f09d7a8e-4d77-468f-95a9-e10b55fe8bba tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:14.705468 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f09d7a8e-4d77-468f-95a9-e10b55fe8bba tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:14.705946 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f09d7a8e-4d77-468f-95a9-e10b55fe8bba tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:14.706373 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f09d7a8e-4d77-468f-95a9-e10b55fe8bba tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:14.707078 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f09d7a8e-4d77-468f-95a9-e10b55fe8bba tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:14.707527 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f09d7a8e-4d77-468f-95a9-e10b55fe8bba tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:14.707970 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f09d7a8e-4d77-468f-95a9-e10b55fe8bba tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:15.070402 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f09d7a8e-4d77-468f-95a9-e10b55fe8bba tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:15.078082 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f09d7a8e-4d77-468f-95a9-e10b55fe8bba tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1515 microversion: 2.1 time: 0.383603 Aug 18 14:55:15.078646 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 285/547] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:14 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1515 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:15.364853 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-6ac0cbb9-6471-4935-ad7f-2d03e3b6727d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:15.365448 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-6ac0cbb9-6471-4935-ad7f-2d03e3b6727d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: e198b9cf-f1a2-4568-831d-201df30f8dec] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:15.372236 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6ac0cbb9-6471-4935-ad7f-2d03e3b6727d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:15.372713 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6ac0cbb9-6471-4935-ad7f-2d03e3b6727d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:15.373139 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6ac0cbb9-6471-4935-ad7f-2d03e3b6727d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:15.373988 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6ac0cbb9-6471-4935-ad7f-2d03e3b6727d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:15.374439 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6ac0cbb9-6471-4935-ad7f-2d03e3b6727d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:15.374856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6ac0cbb9-6471-4935-ad7f-2d03e3b6727d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:15.512285 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6ac0cbb9-6471-4935-ad7f-2d03e3b6727d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:15.522160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-6ac0cbb9-6471-4935-ad7f-2d03e3b6727d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec" status: 200 len: 1514 microversion: 2.1 time: 0.161124 Aug 18 14:55:15.522726 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 286/548] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:15 2022] GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:16.423391 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-01e193ad-f651-456c-bfab-99349355573d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Action: 'create', calling method: .version_select at 0x7fb214309820>, body: {"keypair": {"name": "tempest-keypair-1158265702", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7vy20gcLSrHMoJx4369VxkaxjkYCUno/asR9gVEaekhRmvR+1eJN3HZGFR03zU+aAlkro9XySgMmLbF673gToHWJGVVuL+zixL9Neh6mH56YeWW1BXJf++lbYcUO6CrA=="}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:55:16.439118 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-01e193ad-f651-456c-bfab-99349355573d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Getting quotas for project acc902aa109c4d7291c0bab62f80048e. Resources: {'key_pairs'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:55:16.443072 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-01e193ad-f651-456c-bfab-99349355573d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Getting quotas for user 26eaa7f102bd41028983458ae48ff992 and project acc902aa109c4d7291c0bab62f80048e. Resources: {'key_pairs'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:55:16.466750 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-01e193ad-f651-456c-bfab-99349355573d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046949 Aug 18 14:55:16.467484 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 287/549] 10.222.0.36 () {60 vars in 1159 bytes} [Thu Aug 18 14:55:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:55:16.546955 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8f8b0112-9d2a-4508-9522-c0f4f02098fc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:16.547604 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-8f8b0112-9d2a-4508-9522-c0f4f02098fc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: e198b9cf-f1a2-4568-831d-201df30f8dec] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:16.554212 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8f8b0112-9d2a-4508-9522-c0f4f02098fc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:16.554704 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8f8b0112-9d2a-4508-9522-c0f4f02098fc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:16.555487 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8f8b0112-9d2a-4508-9522-c0f4f02098fc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:16.556263 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8f8b0112-9d2a-4508-9522-c0f4f02098fc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:16.556927 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8f8b0112-9d2a-4508-9522-c0f4f02098fc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:16.557553 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8f8b0112-9d2a-4508-9522-c0f4f02098fc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:16.851446 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8f8b0112-9d2a-4508-9522-c0f4f02098fc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:16.861693 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-8f8b0112-9d2a-4508-9522-c0f4f02098fc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec" status: 200 len: 1514 microversion: 2.1 time: 0.321820 Aug 18 14:55:16.862340 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 288/550] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:16 2022] GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec => generated 1514 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:16.867159 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-4545cdc2-a50a-48c6-9d7f-2584e37767e2 req-ea9c1e56-597a-4a58-8bb9-0b8ad803de28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e198b9cf-f1a2-4568-831d-201df30f8dec", "name": "network-vif-deleted", "tag": "2e2321a1-97a3-4bca-aea1-3514885c55c3"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:55:16.876463 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-4545cdc2-a50a-48c6-9d7f-2584e37767e2 req-ea9c1e56-597a-4a58-8bb9-0b8ad803de28 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:16.877264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-4545cdc2-a50a-48c6-9d7f-2584e37767e2 req-ea9c1e56-597a-4a58-8bb9-0b8ad803de28 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:16.877790 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-4545cdc2-a50a-48c6-9d7f-2584e37767e2 req-ea9c1e56-597a-4a58-8bb9-0b8ad803de28 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:16.883280 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:55:16.892374 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-4545cdc2-a50a-48c6-9d7f-2584e37767e2 req-ea9c1e56-597a-4a58-8bb9-0b8ad803de28 service nova] Creating event network-vif-deleted:2e2321a1-97a3-4bca-aea1-3514885c55c3 for instance e198b9cf-f1a2-4568-831d-201df30f8dec on hv-cinder-85220 Aug 18 14:55:16.898621 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-4545cdc2-a50a-48c6-9d7f-2584e37767e2 req-ea9c1e56-597a-4a58-8bb9-0b8ad803de28 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034978 Aug 18 14:55:16.899210 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 289/551] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:55:17.796567 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-91c30982-b5b6-49f8-9d5d-eef5cbad4ee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-677632495", "imageRef": "4083d76b-6b95-4ed8-8053-69a1270afbd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d605d7f3-d6be-4fb0-ad62-f4590af2952c"}], "security_groups": [{"name": "tempest-securitygroup--1881165889"}], "key_name": "tempest-keypair-1158265702", "user_data": "}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:55:17.909946 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.network.neutron [None req-91c30982-b5b6-49f8-9d5d-eef5cbad4ee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] validate_networks() for [('d605d7f3-d6be-4fb0-ad62-f4590af2952c', None, None, None, None, None)] {{(pid=132268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:55:18.298310 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-91c30982-b5b6-49f8-9d5d-eef5cbad4ee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Flavor limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:55:18.298740 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-91c30982-b5b6-49f8-9d5d-eef5cbad4ee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Image limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:55:18.299219 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-91c30982-b5b6-49f8-9d5d-eef5cbad4ee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Flavor pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:55:18.299628 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-91c30982-b5b6-49f8-9d5d-eef5cbad4ee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Image pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:55:18.300084 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-91c30982-b5b6-49f8-9d5d-eef5cbad4ee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:55:18.310614 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-91c30982-b5b6-49f8-9d5d-eef5cbad4ee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:18.311516 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-91c30982-b5b6-49f8-9d5d-eef5cbad4ee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:18.312053 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-91c30982-b5b6-49f8-9d5d-eef5cbad4ee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:18.312869 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-91c30982-b5b6-49f8-9d5d-eef5cbad4ee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:18.313434 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-91c30982-b5b6-49f8-9d5d-eef5cbad4ee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:18.313865 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-91c30982-b5b6-49f8-9d5d-eef5cbad4ee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:18.332357 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-91c30982-b5b6-49f8-9d5d-eef5cbad4ee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Getting quotas for project acc902aa109c4d7291c0bab62f80048e. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:55:18.336886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-91c30982-b5b6-49f8-9d5d-eef5cbad4ee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Getting quotas for user 26eaa7f102bd41028983458ae48ff992 and project acc902aa109c4d7291c0bab62f80048e. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:55:18.349013 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-91c30982-b5b6-49f8-9d5d-eef5cbad4ee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Going to run 1 instances... {{(pid=132268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:55:18.351568 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-91c30982-b5b6-49f8-9d5d-eef5cbad4ee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4083d76b-6b95-4ed8-8053-69a1270afbd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:55:18.401649 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-91c30982-b5b6-49f8-9d5d-eef5cbad4ee7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.610476 Aug 18 14:55:18.402456 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 290/552] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Aug 18 14:55:17 2022] POST /compute/v2.1/servers => generated 409 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 14:55:18.407802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-eb39a41f-36a3-42bf-adcc-f47f2e9ab090 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:18.408641 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-eb39a41f-36a3-42bf-adcc-f47f2e9ab090 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: e198b9cf-f1a2-4568-831d-201df30f8dec] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:18.416918 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-eb39a41f-36a3-42bf-adcc-f47f2e9ab090 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:18.417402 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-eb39a41f-36a3-42bf-adcc-f47f2e9ab090 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:18.417869 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-eb39a41f-36a3-42bf-adcc-f47f2e9ab090 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:18.418710 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-eb39a41f-36a3-42bf-adcc-f47f2e9ab090 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:18.419169 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-eb39a41f-36a3-42bf-adcc-f47f2e9ab090 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:18.419592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-eb39a41f-36a3-42bf-adcc-f47f2e9ab090 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:18.434582 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-eb39a41f-36a3-42bf-adcc-f47f2e9ab090 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] HTTP exception thrown: Instance e198b9cf-f1a2-4568-831d-201df30f8dec could not be found. Aug 18 14:55:18.436334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-eb39a41f-36a3-42bf-adcc-f47f2e9ab090 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Request method failure captured: Aug 18 14:55:18.436334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec HTTP/1.1 Aug 18 14:55:18.436334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:55:18.436334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:55:18.436334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:55:18.436334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:55:18.436334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:55:18.436334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:55:18.436334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:55:18.436334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:55:18.436334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lJm9sfE03D49GL6sZ71zK6HbcP7pWXFwNZ9TQ2CzlQRQ032pFnURL-H3Wi-VaNR-wft4CPMau6L9Oyyaalcv_gVOj6kaKQ0Yo5p7g6-wDUzTVWdBle6ea_e5kPXCtKqYRmHovd_ewIA61c5ltkItj6qurhkC2oPlzOLLzyvQpDgeVQ Aug 18 14:55:18.436334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:55:18.436334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:55:18.436334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:55:18.436334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:55:18.436334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:55:18.436334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:55:18.436334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: 49b5f78066ec41e98faa23bacd4881cf Aug 18 14:55:18.436334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-VolumesSnapshotTestJSON-549953966 Aug 18 14:55:18.436334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:55:18.436334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:55:18.437939 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/49b5f78066ec41e98faa23bacd4881cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/49b5f78066ec41e98faa23bacd4881cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_49b5f78066ec41e98faa23bacd4881cf", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/49b5f78066ec41e98faa23bacd4881cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:55:18.437939 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-VolumesSnapshotTestJSON-549953966 Aug 18 14:55:18.437939 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: 49b5f78066ec41e98faa23bacd4881cf Aug 18 14:55:18.437939 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-549953966 Aug 18 14:55:18.437939 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-VolumesSnapshotTestJSON-549953966-project Aug 18 14:55:18.437939 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:55:18.437939 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:55:18.437939 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 2ca1c6464b6d432ab1bd3898c69a3e47 Aug 18 14:55:18.437939 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-VolumesSnapshotTestJSON-549953966-project Aug 18 14:55:18.437939 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:55:18.437939 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance e198b9cf-f1a2-4568-831d-201df30f8dec could not be found. Aug 18 14:55:18.437939 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': 'e198b9cf-f1a2-4568-831d-201df30f8dec'} Aug 18 14:55:18.438863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:55:18.438863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:55:18.438863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:55:18.438863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:55:18.438863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:55:18.438863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:55:18.438863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:55:18.438863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:55:18.438863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:55:18.438863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:55:18.438863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e198b9cf-f1a2-4568-831d-201df30f8dec could not be found. Aug 18 14:55:18.438863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:55:18.438863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:55:18.438863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:55:18.438863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:55:18.438863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:55:18.438863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:55:18.438863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:55:18.438863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:55:18.438863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:55:18.440363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:55:18.440363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:55:18.440363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:55:18.440363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:55:18.440363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:55:18.440363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:55:18.440363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:55:18.440363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e198b9cf-f1a2-4568-831d-201df30f8dec could not be found. Aug 18 14:55:18.440363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:55:18.440363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:55:18.440363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:55:18.440363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:55:18.440363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:55:18.440363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:55:18.440363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:55:18.440363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:55:18.440363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e198b9cf-f1a2-4568-831d-201df30f8dec could not be found. Aug 18 14:55:18.440363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:55:18.441971 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-eb39a41f-36a3-42bf-adcc-f47f2e9ab090 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Returning 404 to user: Instance e198b9cf-f1a2-4568-831d-201df30f8dec could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:55:18.441971 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-eb39a41f-36a3-42bf-adcc-f47f2e9ab090 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec" status: 404 len: 111 microversion: 2.1 time: 0.033782 Aug 18 14:55:18.441971 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 291/553] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:18 2022] GET /compute/v2.1/servers/e198b9cf-f1a2-4568-831d-201df30f8dec => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:55:18.442889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-17df69e7-8d7d-41f4-8902-64e88b4f1ab7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:18.443502 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-17df69e7-8d7d-41f4-8902-64e88b4f1ab7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:18.510911 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-17df69e7-8d7d-41f4-8902-64e88b4f1ab7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:18.526237 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-17df69e7-8d7d-41f4-8902-64e88b4f1ab7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1245 microversion: 2.1 time: 0.086263 Aug 18 14:55:18.527371 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 292/554] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:18 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:18.534438 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-aeec79f6-99e1-4066-b394-423a63d08a1a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:18.535419 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-aeec79f6-99e1-4066-b394-423a63d08a1a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:18.543343 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aeec79f6-99e1-4066-b394-423a63d08a1a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:18.544003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aeec79f6-99e1-4066-b394-423a63d08a1a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:18.544526 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aeec79f6-99e1-4066-b394-423a63d08a1a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:18.545745 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aeec79f6-99e1-4066-b394-423a63d08a1a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:18.546442 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aeec79f6-99e1-4066-b394-423a63d08a1a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:18.547659 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aeec79f6-99e1-4066-b394-423a63d08a1a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:18.649054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.objects.instance [None req-aeec79f6-99e1-4066-b394-423a63d08a1a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lazy-loading 'services' on Instance uuid c9d85d35-e080-4901-a147-87b0aaf6c5e5 {{(pid=132268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:55:18.729403 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-aeec79f6-99e1-4066-b394-423a63d08a1a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5/os-volume_attachments/fb2c0520-9ae5-472b-8ded-130f0c438a0c" status: 202 len: 0 microversion: 2.1 time: 0.200352 Aug 18 14:55:18.730221 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 293/555] 10.222.0.36 () {58 vars in 1416 bytes} [Thu Aug 18 14:55:18 2022] DELETE /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5/os-volume_attachments/fb2c0520-9ae5-472b-8ded-130f0c438a0c => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:55:19.549448 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c147cb2f-47db-40fe-b9c8-e06608bb5487 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:19.550137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c147cb2f-47db-40fe-b9c8-e06608bb5487 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:19.556567 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c147cb2f-47db-40fe-b9c8-e06608bb5487 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:19.557054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c147cb2f-47db-40fe-b9c8-e06608bb5487 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:19.557493 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c147cb2f-47db-40fe-b9c8-e06608bb5487 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:19.558185 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c147cb2f-47db-40fe-b9c8-e06608bb5487 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:19.558644 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c147cb2f-47db-40fe-b9c8-e06608bb5487 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:19.559077 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c147cb2f-47db-40fe-b9c8-e06608bb5487 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:19.624365 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c147cb2f-47db-40fe-b9c8-e06608bb5487 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:19.632570 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c147cb2f-47db-40fe-b9c8-e06608bb5487 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1249 microversion: 2.1 time: 0.087851 Aug 18 14:55:19.633134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 294/556] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:19 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1249 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:20.653613 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3115589f-1180-4ab9-83e8-d978b7da6f3f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:20.654291 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-3115589f-1180-4ab9-83e8-d978b7da6f3f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:20.660797 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3115589f-1180-4ab9-83e8-d978b7da6f3f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:20.661276 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3115589f-1180-4ab9-83e8-d978b7da6f3f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:20.661707 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3115589f-1180-4ab9-83e8-d978b7da6f3f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:20.662386 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3115589f-1180-4ab9-83e8-d978b7da6f3f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:20.662839 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3115589f-1180-4ab9-83e8-d978b7da6f3f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:20.663869 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3115589f-1180-4ab9-83e8-d978b7da6f3f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:20.723856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-3115589f-1180-4ab9-83e8-d978b7da6f3f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:20.731510 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-3115589f-1180-4ab9-83e8-d978b7da6f3f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1249 microversion: 2.1 time: 0.081745 Aug 18 14:55:20.732097 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 295/557] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:20 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:21.751145 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b6d32d9c-d3b4-442e-bc72-46c9e3025231 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:21.751779 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b6d32d9c-d3b4-442e-bc72-46c9e3025231 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:21.758187 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b6d32d9c-d3b4-442e-bc72-46c9e3025231 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:21.758667 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b6d32d9c-d3b4-442e-bc72-46c9e3025231 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:21.759099 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b6d32d9c-d3b4-442e-bc72-46c9e3025231 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:21.760074 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b6d32d9c-d3b4-442e-bc72-46c9e3025231 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:21.760529 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b6d32d9c-d3b4-442e-bc72-46c9e3025231 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:21.760953 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b6d32d9c-d3b4-442e-bc72-46c9e3025231 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:21.821743 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b6d32d9c-d3b4-442e-bc72-46c9e3025231 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:21.829621 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b6d32d9c-d3b4-442e-bc72-46c9e3025231 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1249 microversion: 2.1 time: 0.082275 Aug 18 14:55:21.830182 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 296/558] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:21 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:22.592947 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-ac5c4d30-3f95-46e5-853d-f04ccbd006cf req-3dedd432-44ad-4342-a26c-23e02d017280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2b6fc4-0338-4141-9ac3-7b579718fae9", "name": "network-vif-plugged", "status": "completed", "tag": "54c7f937-7b5c-43bd-9d41-2e0484619d5f"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:55:22.604444 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-ac5c4d30-3f95-46e5-853d-f04ccbd006cf req-3dedd432-44ad-4342-a26c-23e02d017280 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:22.605148 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-ac5c4d30-3f95-46e5-853d-f04ccbd006cf req-3dedd432-44ad-4342-a26c-23e02d017280 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:22.605597 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-ac5c4d30-3f95-46e5-853d-f04ccbd006cf req-3dedd432-44ad-4342-a26c-23e02d017280 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:22.619015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-ac5c4d30-3f95-46e5-853d-f04ccbd006cf req-3dedd432-44ad-4342-a26c-23e02d017280 service nova] Creating event network-vif-plugged:54c7f937-7b5c-43bd-9d41-2e0484619d5f for instance 3d2b6fc4-0338-4141-9ac3-7b579718fae9 on hv-cinder-85220 Aug 18 14:55:22.623998 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-ac5c4d30-3f95-46e5-853d-f04ccbd006cf req-3dedd432-44ad-4342-a26c-23e02d017280 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035081 Aug 18 14:55:22.624584 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 297/559] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:55:22.849709 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-28aae8c1-c50a-4957-8dc3-3be1d61ad8e0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:22.851394 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-28aae8c1-c50a-4957-8dc3-3be1d61ad8e0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:22.857269 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-28aae8c1-c50a-4957-8dc3-3be1d61ad8e0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:22.857760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-28aae8c1-c50a-4957-8dc3-3be1d61ad8e0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:22.858199 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-28aae8c1-c50a-4957-8dc3-3be1d61ad8e0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:22.858898 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-28aae8c1-c50a-4957-8dc3-3be1d61ad8e0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:22.859468 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-28aae8c1-c50a-4957-8dc3-3be1d61ad8e0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:22.859856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-28aae8c1-c50a-4957-8dc3-3be1d61ad8e0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:22.932043 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-28aae8c1-c50a-4957-8dc3-3be1d61ad8e0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:22.939881 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-28aae8c1-c50a-4957-8dc3-3be1d61ad8e0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1305 microversion: 2.1 time: 0.094795 Aug 18 14:55:22.940452 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 298/560] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:22 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:23.029284 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-abb2b6b3-9d50-48ab-8b46-6cb6e7339da0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:55:23.035261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-abb2b6b3-9d50-48ab-8b46-6cb6e7339da0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:23.035773 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-abb2b6b3-9d50-48ab-8b46-6cb6e7339da0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:23.036212 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-abb2b6b3-9d50-48ab-8b46-6cb6e7339da0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:23.094641 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-abb2b6b3-9d50-48ab-8b46-6cb6e7339da0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Going to try to stop instance {{(pid=132268) force_stop /opt/stack/nova/nova/compute/api.py:2752}} Aug 18 14:55:23.140395 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-abb2b6b3-9d50-48ab-8b46-6cb6e7339da0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "POST /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5/action" status: 202 len: 0 microversion: 2.1 time: 0.114673 Aug 18 14:55:23.144113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 299/561] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Aug 18 14:55:23 2022] POST /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 14:55:23.151126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-569f477b-2df3-42d9-bea7-ae0c01ca1a52 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:23.152079 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-569f477b-2df3-42d9-bea7-ae0c01ca1a52 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:23.161434 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-569f477b-2df3-42d9-bea7-ae0c01ca1a52 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:23.162139 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-569f477b-2df3-42d9-bea7-ae0c01ca1a52 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:23.163125 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-569f477b-2df3-42d9-bea7-ae0c01ca1a52 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:23.164035 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-569f477b-2df3-42d9-bea7-ae0c01ca1a52 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:23.164549 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-569f477b-2df3-42d9-bea7-ae0c01ca1a52 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:23.164952 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-569f477b-2df3-42d9-bea7-ae0c01ca1a52 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:23.343111 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-569f477b-2df3-42d9-bea7-ae0c01ca1a52 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:23.352332 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-569f477b-2df3-42d9-bea7-ae0c01ca1a52 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1677 microversion: 2.1 time: 0.206760 Aug 18 14:55:23.353037 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 300/562] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:23 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1677 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:23.962190 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-eccc63ec-eac2-4e42-a8ef-1f9e9b1ffab1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:23.962835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-eccc63ec-eac2-4e42-a8ef-1f9e9b1ffab1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:23.965228 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:55:23.970317 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-eccc63ec-eac2-4e42-a8ef-1f9e9b1ffab1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:23.970857 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-eccc63ec-eac2-4e42-a8ef-1f9e9b1ffab1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:23.971281 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-eccc63ec-eac2-4e42-a8ef-1f9e9b1ffab1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:23.972022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-eccc63ec-eac2-4e42-a8ef-1f9e9b1ffab1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:23.972467 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-eccc63ec-eac2-4e42-a8ef-1f9e9b1ffab1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:23.972882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-eccc63ec-eac2-4e42-a8ef-1f9e9b1ffab1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:24.053837 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-eccc63ec-eac2-4e42-a8ef-1f9e9b1ffab1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:24.061804 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-eccc63ec-eac2-4e42-a8ef-1f9e9b1ffab1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1303 microversion: 2.1 time: 0.103987 Aug 18 14:55:24.062594 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 301/563] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:23 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:24.373299 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e352f561-92aa-43c6-a6cc-76372e6f69f1 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:24.373914 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e352f561-92aa-43c6-a6cc-76372e6f69f1 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:24.380211 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e352f561-92aa-43c6-a6cc-76372e6f69f1 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:24.380697 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e352f561-92aa-43c6-a6cc-76372e6f69f1 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:24.381130 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e352f561-92aa-43c6-a6cc-76372e6f69f1 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:24.381832 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e352f561-92aa-43c6-a6cc-76372e6f69f1 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:24.382284 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e352f561-92aa-43c6-a6cc-76372e6f69f1 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:24.382707 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e352f561-92aa-43c6-a6cc-76372e6f69f1 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:24.528478 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e352f561-92aa-43c6-a6cc-76372e6f69f1 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:24.536882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e352f561-92aa-43c6-a6cc-76372e6f69f1 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1677 microversion: 2.1 time: 0.167377 Aug 18 14:55:24.537378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 302/564] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:24 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:25.082167 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-7cd941fa-3544-4429-807f-c86578841111 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:25.082783 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-7cd941fa-3544-4429-807f-c86578841111 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:25.089697 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7cd941fa-3544-4429-807f-c86578841111 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:25.090183 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7cd941fa-3544-4429-807f-c86578841111 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:25.090640 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7cd941fa-3544-4429-807f-c86578841111 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:25.091332 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7cd941fa-3544-4429-807f-c86578841111 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:25.091812 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7cd941fa-3544-4429-807f-c86578841111 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:25.092238 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7cd941fa-3544-4429-807f-c86578841111 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:25.221548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-7cd941fa-3544-4429-807f-c86578841111 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:25.229173 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-7cd941fa-3544-4429-807f-c86578841111 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1371 microversion: 2.1 time: 0.150841 Aug 18 14:55:25.229721 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 303/565] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:25 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:25.558214 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5640131d-1d3e-4b62-b3b6-6bc53a9cc443 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:25.558818 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-5640131d-1d3e-4b62-b3b6-6bc53a9cc443 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:25.564888 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5640131d-1d3e-4b62-b3b6-6bc53a9cc443 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:25.565363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5640131d-1d3e-4b62-b3b6-6bc53a9cc443 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:25.565792 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5640131d-1d3e-4b62-b3b6-6bc53a9cc443 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:25.566469 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5640131d-1d3e-4b62-b3b6-6bc53a9cc443 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:25.566923 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5640131d-1d3e-4b62-b3b6-6bc53a9cc443 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:25.567339 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5640131d-1d3e-4b62-b3b6-6bc53a9cc443 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:25.706034 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-5640131d-1d3e-4b62-b3b6-6bc53a9cc443 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:25.714061 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-5640131d-1d3e-4b62-b3b6-6bc53a9cc443 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1677 microversion: 2.1 time: 0.160120 Aug 18 14:55:25.714629 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 304/566] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:25 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:25.828965 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f8deab66-b8be-48eb-8f09-7c21ed75ac19 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:25.829379 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f8deab66-b8be-48eb-8f09-7c21ed75ac19 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:25.838902 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f8deab66-b8be-48eb-8f09-7c21ed75ac19 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:25.839797 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f8deab66-b8be-48eb-8f09-7c21ed75ac19 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:25.840404 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f8deab66-b8be-48eb-8f09-7c21ed75ac19 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:25.841150 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f8deab66-b8be-48eb-8f09-7c21ed75ac19 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:25.841647 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f8deab66-b8be-48eb-8f09-7c21ed75ac19 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:25.842205 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f8deab66-b8be-48eb-8f09-7c21ed75ac19 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:25.868679 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f8deab66-b8be-48eb-8f09-7c21ed75ac19 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164/ips" status: 200 len: 150 microversion: 2.1 time: 0.043600 Aug 18 14:55:25.869260 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 305/567] 10.222.0.36 () {58 vars in 1248 bytes} [Thu Aug 18 14:55:25 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:55:25.880396 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3ba5095e-9498-4518-b39c-aa092f611076 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31bd0bde-d58f-40fc-87ae-ff1d5cf47d92"}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:55:25.883110 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-3ba5095e-9498-4518-b39c-aa092f611076 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:25.889456 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3ba5095e-9498-4518-b39c-aa092f611076 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:25.889941 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3ba5095e-9498-4518-b39c-aa092f611076 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:25.890360 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3ba5095e-9498-4518-b39c-aa092f611076 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:25.891043 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3ba5095e-9498-4518-b39c-aa092f611076 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:25.891490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3ba5095e-9498-4518-b39c-aa092f611076 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:25.891932 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3ba5095e-9498-4518-b39c-aa092f611076 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:25.977810 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-3ba5095e-9498-4518-b39c-aa092f611076 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] HTTP exception thrown: Invalid volume: volume 31bd0bde-d58f-40fc-87ae-ff1d5cf47d92 is already attached to instances: 89777120-9e0a-40d0-b71d-b73882a1a5e6 Aug 18 14:55:25.979548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3ba5095e-9498-4518-b39c-aa092f611076 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Request method failure captured: Aug 18 14:55:25.979548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: POST /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164/os-volume_attachments HTTP/1.1 Aug 18 14:55:25.979548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:55:25.979548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:55:25.979548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:55:25.979548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 74 Aug 18 14:55:25.979548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:55:25.979548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:55:25.979548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:55:25.979548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:55:25.979548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lH4oIml6txed07XrppfY0Z5jhCeqS9LCxxoulg2eAhfaJ8WphU-pzn12EaO7FXV8VEwOuzjKQEfCBldz9fUbgppMEKJd_VSbDb_aR-Ce__ScpKEICpMOfadH5ZH-EfODQJGUEz0cyaOMRlNct6asFRrMu0s30r91ZjclG___yh0IIw Aug 18 14:55:25.979548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:55:25.979548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:55:25.979548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:55:25.979548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:55:25.979548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:55:25.979548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:55:25.979548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:55:25.979548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:55:25.979548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:55:25.979548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:55:25.981144 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_55c9fe0cbbfa47bca81668c039afc092", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:55:25.981144 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:55:25.981144 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:55:25.981144 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:55:25.981144 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:55:25.981144 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:55:25.981144 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:55:25.981144 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 36dbc938bcd741f2a2b2013b6aa6f008 Aug 18 14:55:25.981144 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:55:25.981144 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Aug 18 14:55:25.981144 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {"volumeAttachment": {"volumeId": "31bd0bde-d58f-40fc-87ae-ff1d5cf47d92"}} Aug 18 14:55:25.981144 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:55:25.982046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Invalid volume: volume 31bd0bde-d58f-40fc-87ae-ff1d5cf47d92 is already attached to instances: 89777120-9e0a-40d0-b71d-b73882a1a5e6 Aug 18 14:55:25.982046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'server_id': 'aa15c998-af91-4654-9cf6-ee7b4b1da164', 'body': {'volumeAttachment': {'volumeId': '31bd0bde-d58f-40fc-87ae-ff1d5cf47d92'}}} Aug 18 14:55:25.982046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:55:25.982046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:55:25.982046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 18 14:55:25.982046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 18 14:55:25.982046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 14:55:25.982046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 14:55:25.982046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 18 14:55:25.982046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 14:55:25.982046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5122, in attach_volume Aug 18 14:55:25.982046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 18 14:55:25.982046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4962, in _check_volume_already_attached Aug 18 14:55:25.982046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 18 14:55:25.982046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 31bd0bde-d58f-40fc-87ae-ff1d5cf47d92 is already attached to instances: 89777120-9e0a-40d0-b71d-b73882a1a5e6 Aug 18 14:55:25.982046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:55:25.982046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:55:25.982046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:55:25.982046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:55:25.983390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:55:25.983390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:55:25.983390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:55:25.983390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:55:25.983390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:55:25.983390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:55:25.983390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 14:55:25.983390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 14:55:25.983390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 14:55:25.983390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 14:55:25.983390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 14:55:25.983390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 14:55:25.983390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 18 14:55:25.983390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 18 14:55:25.983390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 31bd0bde-d58f-40fc-87ae-ff1d5cf47d92 is already attached to instances: 89777120-9e0a-40d0-b71d-b73882a1a5e6 Aug 18 14:55:25.983390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:55:25.983390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:55:25.983390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:55:25.983390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:55:25.983390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:55:25.984793 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:55:25.984793 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:55:25.984793 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:55:25.984793 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 31bd0bde-d58f-40fc-87ae-ff1d5cf47d92 is already attached to instances: 89777120-9e0a-40d0-b71d-b73882a1a5e6 Aug 18 14:55:25.984793 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:55:25.984793 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3ba5095e-9498-4518-b39c-aa092f611076 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Returning 400 to user: Invalid volume: volume 31bd0bde-d58f-40fc-87ae-ff1d5cf47d92 is already attached to instances: 89777120-9e0a-40d0-b71d-b73882a1a5e6 {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:55:25.984793 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-3ba5095e-9498-4518-b39c-aa092f611076 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "POST /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104342 Aug 18 14:55:25.984793 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 306/568] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Aug 18 14:55:25 2022] POST /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 18 14:55:25.990369 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-53055b38-9c7e-4f82-9ef7-eeee777d3804 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:25.990866 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-53055b38-9c7e-4f82-9ef7-eeee777d3804 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:25.997676 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-53055b38-9c7e-4f82-9ef7-eeee777d3804 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:25.998158 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-53055b38-9c7e-4f82-9ef7-eeee777d3804 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:25.998593 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-53055b38-9c7e-4f82-9ef7-eeee777d3804 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:25.999287 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-53055b38-9c7e-4f82-9ef7-eeee777d3804 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:25.999779 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-53055b38-9c7e-4f82-9ef7-eeee777d3804 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:26.000203 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-53055b38-9c7e-4f82-9ef7-eeee777d3804 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:26.026138 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-53055b38-9c7e-4f82-9ef7-eeee777d3804 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Going to try to terminate instance {{(pid=132268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:55:26.040421 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:55:26.105047 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-53055b38-9c7e-4f82-9ef7-eeee777d3804 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "DELETE /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 204 len: 0 microversion: 2.1 time: 0.117959 Aug 18 14:55:26.105689 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 307/569] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 14:55:25 2022] DELETE /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 14:55:26.114879 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2e5c6cb4-4083-497e-9948-9aad3637da94 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:26.115192 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2e5c6cb4-4083-497e-9948-9aad3637da94 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:26.121177 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2e5c6cb4-4083-497e-9948-9aad3637da94 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:26.121656 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2e5c6cb4-4083-497e-9948-9aad3637da94 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:26.122104 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2e5c6cb4-4083-497e-9948-9aad3637da94 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:26.122773 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2e5c6cb4-4083-497e-9948-9aad3637da94 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:26.123337 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2e5c6cb4-4083-497e-9948-9aad3637da94 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:26.123776 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2e5c6cb4-4083-497e-9948-9aad3637da94 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:26.261403 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2e5c6cb4-4083-497e-9948-9aad3637da94 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:26.270116 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2e5c6cb4-4083-497e-9948-9aad3637da94 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1681 microversion: 2.1 time: 0.159721 Aug 18 14:55:26.270687 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 308/570] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:26 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:26.275781 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-fbe3a7c4-d079-47c8-9491-096b4cc44af5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:26.276395 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-fbe3a7c4-d079-47c8-9491-096b4cc44af5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:26.282636 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fbe3a7c4-d079-47c8-9491-096b4cc44af5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:26.283129 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fbe3a7c4-d079-47c8-9491-096b4cc44af5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:26.283574 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fbe3a7c4-d079-47c8-9491-096b4cc44af5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:26.284455 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fbe3a7c4-d079-47c8-9491-096b4cc44af5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:26.284919 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fbe3a7c4-d079-47c8-9491-096b4cc44af5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:26.285516 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fbe3a7c4-d079-47c8-9491-096b4cc44af5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:26.426073 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-fbe3a7c4-d079-47c8-9491-096b4cc44af5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:26.434464 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-fbe3a7c4-d079-47c8-9491-096b4cc44af5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1371 microversion: 2.1 time: 0.162809 Aug 18 14:55:26.435042 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 309/571] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:26 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:26.734757 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8f8d2005-5131-4663-a569-cfe4edf7f0c7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:26.735362 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-8f8d2005-5131-4663-a569-cfe4edf7f0c7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:26.741943 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8f8d2005-5131-4663-a569-cfe4edf7f0c7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:26.742424 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8f8d2005-5131-4663-a569-cfe4edf7f0c7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:26.742851 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8f8d2005-5131-4663-a569-cfe4edf7f0c7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:26.743539 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8f8d2005-5131-4663-a569-cfe4edf7f0c7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:26.744012 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8f8d2005-5131-4663-a569-cfe4edf7f0c7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:26.744434 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8f8d2005-5131-4663-a569-cfe4edf7f0c7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:26.875035 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8f8d2005-5131-4663-a569-cfe4edf7f0c7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:26.883317 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-8f8d2005-5131-4663-a569-cfe4edf7f0c7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1677 microversion: 2.1 time: 0.152393 Aug 18 14:55:26.883906 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 310/572] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:26 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:27.293015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-70d23879-9667-4f4e-935a-1162c25c7d1c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:27.293669 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-70d23879-9667-4f4e-935a-1162c25c7d1c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:27.299695 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-70d23879-9667-4f4e-935a-1162c25c7d1c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:27.300184 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-70d23879-9667-4f4e-935a-1162c25c7d1c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:27.300608 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-70d23879-9667-4f4e-935a-1162c25c7d1c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:27.301296 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-70d23879-9667-4f4e-935a-1162c25c7d1c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:27.301744 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-70d23879-9667-4f4e-935a-1162c25c7d1c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:27.302172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-70d23879-9667-4f4e-935a-1162c25c7d1c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:27.470452 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-70d23879-9667-4f4e-935a-1162c25c7d1c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:27.479143 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-70d23879-9667-4f4e-935a-1162c25c7d1c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1681 microversion: 2.1 time: 0.189982 Aug 18 14:55:27.479739 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 311/573] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:27 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:27.494138 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a203506c-e5d4-4af3-ba20-9b17794d6986 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:27.494138 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a203506c-e5d4-4af3-ba20-9b17794d6986 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:27.494138 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a203506c-e5d4-4af3-ba20-9b17794d6986 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:27.494138 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a203506c-e5d4-4af3-ba20-9b17794d6986 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:27.494552 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a203506c-e5d4-4af3-ba20-9b17794d6986 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:27.494552 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a203506c-e5d4-4af3-ba20-9b17794d6986 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:27.494552 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a203506c-e5d4-4af3-ba20-9b17794d6986 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:27.494552 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a203506c-e5d4-4af3-ba20-9b17794d6986 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:27.739385 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a203506c-e5d4-4af3-ba20-9b17794d6986 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:27.747797 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a203506c-e5d4-4af3-ba20-9b17794d6986 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1371 microversion: 2.1 time: 0.267041 Aug 18 14:55:27.748367 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 312/574] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:27 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1371 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:27.905159 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a0a74368-fe85-45d8-821e-6524598ee209 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:27.905838 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a0a74368-fe85-45d8-821e-6524598ee209 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:27.911912 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a0a74368-fe85-45d8-821e-6524598ee209 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:27.912391 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a0a74368-fe85-45d8-821e-6524598ee209 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:27.912815 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a0a74368-fe85-45d8-821e-6524598ee209 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:27.913502 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a0a74368-fe85-45d8-821e-6524598ee209 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:27.913980 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a0a74368-fe85-45d8-821e-6524598ee209 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:27.914390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a0a74368-fe85-45d8-821e-6524598ee209 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:28.117266 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a0a74368-fe85-45d8-821e-6524598ee209 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:28.125797 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a0a74368-fe85-45d8-821e-6524598ee209 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1677 microversion: 2.1 time: 0.225020 Aug 18 14:55:28.126426 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 313/575] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:27 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1677 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:28.135889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-ca8f3c14-d569-4eba-89af-3021e97bd2d1 req-8f8ca8b1-5cd6-4e05-9105-ec5276f29331 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9163961-387b-4e9b-94a8-9647dde7c208", "tag": "e57de99a-4074-41f9-9a26-248196b630ba"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:55:28.149612 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-ca8f3c14-d569-4eba-89af-3021e97bd2d1 req-8f8ca8b1-5cd6-4e05-9105-ec5276f29331 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:28.150081 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-ca8f3c14-d569-4eba-89af-3021e97bd2d1 req-8f8ca8b1-5cd6-4e05-9105-ec5276f29331 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:28.150505 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-ca8f3c14-d569-4eba-89af-3021e97bd2d1 req-8f8ca8b1-5cd6-4e05-9105-ec5276f29331 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:28.162117 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-ca8f3c14-d569-4eba-89af-3021e97bd2d1 req-8f8ca8b1-5cd6-4e05-9105-ec5276f29331 service nova] Creating event network-changed:e57de99a-4074-41f9-9a26-248196b630ba for instance d9163961-387b-4e9b-94a8-9647dde7c208 on hv-cinder-85220 Aug 18 14:55:28.168322 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-ca8f3c14-d569-4eba-89af-3021e97bd2d1 req-8f8ca8b1-5cd6-4e05-9105-ec5276f29331 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036170 Aug 18 14:55:28.168909 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 314/576] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:55:28.386741 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-cfefe85b-2c33-42d9-abdc-46e04e400d9c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-562488480", "imageRef": "4083d76b-6b95-4ed8-8053-69a1270afbd4", "flavorRef": "452", "networks": [{"uuid": "8c65343e-5da4-4810-a504-0bd42fa220ea"}]}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:55:28.395125 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=2 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:55:28.439467 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.network.neutron [None req-cfefe85b-2c33-42d9-abdc-46e04e400d9c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] validate_networks() for [('8c65343e-5da4-4810-a504-0bd42fa220ea', None, None, None, None, None)] {{(pid=132268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:55:28.523267 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=12 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:55:29.019977 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-cfefe85b-2c33-42d9-abdc-46e04e400d9c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Flavor limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:55:29.020398 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-cfefe85b-2c33-42d9-abdc-46e04e400d9c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Image limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:55:29.020900 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-cfefe85b-2c33-42d9-abdc-46e04e400d9c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Flavor pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:55:29.021649 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-cfefe85b-2c33-42d9-abdc-46e04e400d9c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Image pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:55:29.022088 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-cfefe85b-2c33-42d9-abdc-46e04e400d9c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:55:29.031844 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cfefe85b-2c33-42d9-abdc-46e04e400d9c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:29.032512 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cfefe85b-2c33-42d9-abdc-46e04e400d9c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:29.032941 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cfefe85b-2c33-42d9-abdc-46e04e400d9c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:29.033663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cfefe85b-2c33-42d9-abdc-46e04e400d9c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:29.034113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cfefe85b-2c33-42d9-abdc-46e04e400d9c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:29.034539 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cfefe85b-2c33-42d9-abdc-46e04e400d9c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:29.050968 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-cfefe85b-2c33-42d9-abdc-46e04e400d9c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Getting quotas for project 49b5f78066ec41e98faa23bacd4881cf. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:55:29.055094 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-cfefe85b-2c33-42d9-abdc-46e04e400d9c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Getting quotas for user 2ca1c6464b6d432ab1bd3898c69a3e47 and project 49b5f78066ec41e98faa23bacd4881cf. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:55:29.065959 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-cfefe85b-2c33-42d9-abdc-46e04e400d9c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Going to run 1 instances... {{(pid=132268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:55:29.068282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-cfefe85b-2c33-42d9-abdc-46e04e400d9c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: 359bcf74-3804-413e-9c13-4fcd166074c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4083d76b-6b95-4ed8-8053-69a1270afbd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:55:29.111648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-cfefe85b-2c33-42d9-abdc-46e04e400d9c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.729409 Aug 18 14:55:29.112302 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 315/577] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Aug 18 14:55:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 14:55:29.116796 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a43a2153-5c9c-452a-aba8-69851ad36d39 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:29.117402 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a43a2153-5c9c-452a-aba8-69851ad36d39 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:29.123582 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a43a2153-5c9c-452a-aba8-69851ad36d39 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:29.124084 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a43a2153-5c9c-452a-aba8-69851ad36d39 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:29.124513 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a43a2153-5c9c-452a-aba8-69851ad36d39 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:29.125195 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a43a2153-5c9c-452a-aba8-69851ad36d39 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:29.125641 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a43a2153-5c9c-452a-aba8-69851ad36d39 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:29.126056 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a43a2153-5c9c-452a-aba8-69851ad36d39 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:29.266459 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a43a2153-5c9c-452a-aba8-69851ad36d39 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:29.275638 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a43a2153-5c9c-452a-aba8-69851ad36d39 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1681 microversion: 2.1 time: 0.162352 Aug 18 14:55:29.276223 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 316/578] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:29 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:29.281339 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a09334b3-9230-40d1-9ac3-b33ac1f6adce tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:29.281339 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a09334b3-9230-40d1-9ac3-b33ac1f6adce tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:29.287152 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a09334b3-9230-40d1-9ac3-b33ac1f6adce tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:29.288196 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a09334b3-9230-40d1-9ac3-b33ac1f6adce tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:29.288319 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a09334b3-9230-40d1-9ac3-b33ac1f6adce tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:29.288932 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a09334b3-9230-40d1-9ac3-b33ac1f6adce tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:29.289374 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a09334b3-9230-40d1-9ac3-b33ac1f6adce tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:29.289798 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a09334b3-9230-40d1-9ac3-b33ac1f6adce tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:29.441041 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a09334b3-9230-40d1-9ac3-b33ac1f6adce tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:29.448985 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a09334b3-9230-40d1-9ac3-b33ac1f6adce tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1371 microversion: 2.1 time: 0.171776 Aug 18 14:55:29.449758 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 317/579] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:29 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:29.470368 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c552c440-3d1c-4184-ac39-7568059509b7 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:29.471666 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c552c440-3d1c-4184-ac39-7568059509b7 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: 359bcf74-3804-413e-9c13-4fcd166074c1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:29.541173 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c552c440-3d1c-4184-ac39-7568059509b7 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:29.549043 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c552c440-3d1c-4184-ac39-7568059509b7 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1" status: 200 len: 1218 microversion: 2.1 time: 0.085569 Aug 18 14:55:29.549825 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 318/580] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:29 2022] GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:29.554629 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-26b68a09-e379-4cab-b884-d02c14e3d538 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:29.555417 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-26b68a09-e379-4cab-b884-d02c14e3d538 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:29.561600 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26b68a09-e379-4cab-b884-d02c14e3d538 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:29.562300 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26b68a09-e379-4cab-b884-d02c14e3d538 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:29.562742 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26b68a09-e379-4cab-b884-d02c14e3d538 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:29.563445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26b68a09-e379-4cab-b884-d02c14e3d538 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:29.563934 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26b68a09-e379-4cab-b884-d02c14e3d538 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:29.564628 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26b68a09-e379-4cab-b884-d02c14e3d538 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:29.710353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-26b68a09-e379-4cab-b884-d02c14e3d538 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:29.718295 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-26b68a09-e379-4cab-b884-d02c14e3d538 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1677 microversion: 2.1 time: 0.167327 Aug 18 14:55:29.718736 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 319/581] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:29 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:30.297044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-6c1e811b-e6f2-4d32-b5ed-be873ee2331e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:30.297688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-6c1e811b-e6f2-4d32-b5ed-be873ee2331e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:30.304268 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6c1e811b-e6f2-4d32-b5ed-be873ee2331e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:30.304746 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6c1e811b-e6f2-4d32-b5ed-be873ee2331e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:30.305176 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6c1e811b-e6f2-4d32-b5ed-be873ee2331e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:30.305853 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6c1e811b-e6f2-4d32-b5ed-be873ee2331e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:30.306302 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6c1e811b-e6f2-4d32-b5ed-be873ee2331e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:30.306719 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6c1e811b-e6f2-4d32-b5ed-be873ee2331e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:30.433710 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6c1e811b-e6f2-4d32-b5ed-be873ee2331e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:30.441352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-6c1e811b-e6f2-4d32-b5ed-be873ee2331e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1681 microversion: 2.1 time: 0.148175 Aug 18 14:55:30.441902 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 320/582] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:30 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:30.473737 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2fe7038c-99b1-4a20-9ee6-b5ff32001f05 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:30.474632 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2fe7038c-99b1-4a20-9ee6-b5ff32001f05 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:30.480689 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2fe7038c-99b1-4a20-9ee6-b5ff32001f05 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:30.481177 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2fe7038c-99b1-4a20-9ee6-b5ff32001f05 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:30.481611 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2fe7038c-99b1-4a20-9ee6-b5ff32001f05 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:30.482309 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2fe7038c-99b1-4a20-9ee6-b5ff32001f05 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:30.482769 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2fe7038c-99b1-4a20-9ee6-b5ff32001f05 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:30.483192 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2fe7038c-99b1-4a20-9ee6-b5ff32001f05 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:30.620762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2fe7038c-99b1-4a20-9ee6-b5ff32001f05 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:30.628555 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2fe7038c-99b1-4a20-9ee6-b5ff32001f05 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1371 microversion: 2.1 time: 0.158915 Aug 18 14:55:30.629125 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 321/583] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:30 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:30.633674 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-450920ad-1fff-42e0-8281-bc7af32d9361 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:30.634279 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-450920ad-1fff-42e0-8281-bc7af32d9361 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: 359bcf74-3804-413e-9c13-4fcd166074c1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:30.640042 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-450920ad-1fff-42e0-8281-bc7af32d9361 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:30.640519 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-450920ad-1fff-42e0-8281-bc7af32d9361 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:30.640949 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-450920ad-1fff-42e0-8281-bc7af32d9361 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:30.641632 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-450920ad-1fff-42e0-8281-bc7af32d9361 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:30.642083 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-450920ad-1fff-42e0-8281-bc7af32d9361 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:30.642502 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-450920ad-1fff-42e0-8281-bc7af32d9361 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:30.703497 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-450920ad-1fff-42e0-8281-bc7af32d9361 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:30.711141 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-450920ad-1fff-42e0-8281-bc7af32d9361 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1" status: 200 len: 1222 microversion: 2.1 time: 0.080909 Aug 18 14:55:30.711709 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 322/584] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:30 2022] GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:30.740581 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a5d6802c-190e-427b-b112-bf47e6384275 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:30.741698 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a5d6802c-190e-427b-b112-bf47e6384275 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:30.747393 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a5d6802c-190e-427b-b112-bf47e6384275 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:30.747917 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a5d6802c-190e-427b-b112-bf47e6384275 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:30.748341 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a5d6802c-190e-427b-b112-bf47e6384275 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:30.749059 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a5d6802c-190e-427b-b112-bf47e6384275 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:30.749514 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a5d6802c-190e-427b-b112-bf47e6384275 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:30.749934 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a5d6802c-190e-427b-b112-bf47e6384275 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:30.883985 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a5d6802c-190e-427b-b112-bf47e6384275 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:30.892152 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a5d6802c-190e-427b-b112-bf47e6384275 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1677 microversion: 2.1 time: 0.155051 Aug 18 14:55:30.892903 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 323/585] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:30 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:31.462398 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3a6e72ec-bbfd-4da8-91c6-e9c4f7da63ce tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:31.463116 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-3a6e72ec-bbfd-4da8-91c6-e9c4f7da63ce tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:31.469850 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3a6e72ec-bbfd-4da8-91c6-e9c4f7da63ce tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:31.470425 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3a6e72ec-bbfd-4da8-91c6-e9c4f7da63ce tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:31.470894 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3a6e72ec-bbfd-4da8-91c6-e9c4f7da63ce tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:31.471583 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3a6e72ec-bbfd-4da8-91c6-e9c4f7da63ce tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:31.472106 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3a6e72ec-bbfd-4da8-91c6-e9c4f7da63ce tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:31.472538 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3a6e72ec-bbfd-4da8-91c6-e9c4f7da63ce tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:31.701173 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-3a6e72ec-bbfd-4da8-91c6-e9c4f7da63ce tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:31.709271 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-3a6e72ec-bbfd-4da8-91c6-e9c4f7da63ce tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1681 microversion: 2.1 time: 0.250740 Aug 18 14:55:31.709954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 324/586] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:31 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1681 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:31.714691 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-98a30892-1538-43df-92ea-7ef261c0c9bd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:31.715296 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-98a30892-1538-43df-92ea-7ef261c0c9bd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:31.721091 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-98a30892-1538-43df-92ea-7ef261c0c9bd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:31.721570 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-98a30892-1538-43df-92ea-7ef261c0c9bd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:31.721999 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-98a30892-1538-43df-92ea-7ef261c0c9bd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:31.722718 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-98a30892-1538-43df-92ea-7ef261c0c9bd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:31.723169 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-98a30892-1538-43df-92ea-7ef261c0c9bd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:31.723800 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-98a30892-1538-43df-92ea-7ef261c0c9bd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:31.739064 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:55:31.967362 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-98a30892-1538-43df-92ea-7ef261c0c9bd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:31.975890 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-98a30892-1538-43df-92ea-7ef261c0c9bd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1371 microversion: 2.1 time: 0.264183 Aug 18 14:55:31.976479 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 325/587] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:31 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1371 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:31.980997 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-695e8841-8f80-4021-804e-aa3ef5d39ebc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:31.981601 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-695e8841-8f80-4021-804e-aa3ef5d39ebc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: 359bcf74-3804-413e-9c13-4fcd166074c1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:31.987701 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-695e8841-8f80-4021-804e-aa3ef5d39ebc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:31.988263 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-695e8841-8f80-4021-804e-aa3ef5d39ebc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:31.988698 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-695e8841-8f80-4021-804e-aa3ef5d39ebc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:31.989476 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-695e8841-8f80-4021-804e-aa3ef5d39ebc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:31.990017 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-695e8841-8f80-4021-804e-aa3ef5d39ebc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:31.990448 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-695e8841-8f80-4021-804e-aa3ef5d39ebc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:32.100616 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-695e8841-8f80-4021-804e-aa3ef5d39ebc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:32.109216 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-695e8841-8f80-4021-804e-aa3ef5d39ebc tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1" status: 200 len: 1270 microversion: 2.1 time: 0.131715 Aug 18 14:55:32.120805 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 326/588] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:31 2022] GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1 => generated 1270 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:32.126995 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d8276cb0-de48-4533-bda7-3ecebcd9c0c0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:32.127534 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d8276cb0-de48-4533-bda7-3ecebcd9c0c0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:32.134555 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d8276cb0-de48-4533-bda7-3ecebcd9c0c0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:32.135303 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d8276cb0-de48-4533-bda7-3ecebcd9c0c0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:32.135761 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d8276cb0-de48-4533-bda7-3ecebcd9c0c0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:32.136459 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d8276cb0-de48-4533-bda7-3ecebcd9c0c0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:32.137359 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d8276cb0-de48-4533-bda7-3ecebcd9c0c0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:32.137475 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d8276cb0-de48-4533-bda7-3ecebcd9c0c0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:32.406196 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d8276cb0-de48-4533-bda7-3ecebcd9c0c0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:32.419061 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d8276cb0-de48-4533-bda7-3ecebcd9c0c0 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1677 microversion: 2.1 time: 0.297065 Aug 18 14:55:32.434037 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 327/589] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:32 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1677 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:32.437551 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-86d117f4-bcca-4552-b52b-f85bb0ea89ab req-d6430ba8-1c13-41de-ba7e-3c7b864a4ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa15c998-af91-4654-9cf6-ee7b4b1da164", "name": "network-vif-deleted", "tag": "c53b5061-6ea7-41b4-b0ac-30785ff1f9b9"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:55:32.455725 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-86d117f4-bcca-4552-b52b-f85bb0ea89ab req-d6430ba8-1c13-41de-ba7e-3c7b864a4ef0 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:32.456190 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-86d117f4-bcca-4552-b52b-f85bb0ea89ab req-d6430ba8-1c13-41de-ba7e-3c7b864a4ef0 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:32.456651 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-86d117f4-bcca-4552-b52b-f85bb0ea89ab req-d6430ba8-1c13-41de-ba7e-3c7b864a4ef0 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:32.494985 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-86d117f4-bcca-4552-b52b-f85bb0ea89ab req-d6430ba8-1c13-41de-ba7e-3c7b864a4ef0 service nova] Creating event network-vif-deleted:c53b5061-6ea7-41b4-b0ac-30785ff1f9b9 for instance aa15c998-af91-4654-9cf6-ee7b4b1da164 on hv-cinder-85220 Aug 18 14:55:32.501234 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-86d117f4-bcca-4552-b52b-f85bb0ea89ab req-d6430ba8-1c13-41de-ba7e-3c7b864a4ef0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080408 Aug 18 14:55:32.502046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 328/590] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:55:32.732058 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d432010b-4e38-4629-b507-b70e94fb0f66 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:32.733007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d432010b-4e38-4629-b507-b70e94fb0f66 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:32.742294 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d432010b-4e38-4629-b507-b70e94fb0f66 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:32.750060 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d432010b-4e38-4629-b507-b70e94fb0f66 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:32.750601 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d432010b-4e38-4629-b507-b70e94fb0f66 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:32.751379 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d432010b-4e38-4629-b507-b70e94fb0f66 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:32.754911 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d432010b-4e38-4629-b507-b70e94fb0f66 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:32.756034 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d432010b-4e38-4629-b507-b70e94fb0f66 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:32.805873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d432010b-4e38-4629-b507-b70e94fb0f66 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:32.806563 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d432010b-4e38-4629-b507-b70e94fb0f66 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:32.806991 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d432010b-4e38-4629-b507-b70e94fb0f66 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:32.807888 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.objects.instance [None req-d432010b-4e38-4629-b507-b70e94fb0f66 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lazy-loading 'fault' on Instance uuid aa15c998-af91-4654-9cf6-ee7b4b1da164 {{(pid=132268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:55:32.854214 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d432010b-4e38-4629-b507-b70e94fb0f66 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:32.862349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d432010b-4e38-4629-b507-b70e94fb0f66 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1331 microversion: 2.1 time: 0.134464 Aug 18 14:55:32.862926 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 329/591] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:32 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1331 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:32.997744 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-668b210e-9b26-415b-9819-d257d830aeab tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:32.998364 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-668b210e-9b26-415b-9819-d257d830aeab tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:33.022811 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-668b210e-9b26-415b-9819-d257d830aeab tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:33.023311 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-668b210e-9b26-415b-9819-d257d830aeab tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:33.024597 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-668b210e-9b26-415b-9819-d257d830aeab tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:33.025325 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-668b210e-9b26-415b-9819-d257d830aeab tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:33.026222 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-668b210e-9b26-415b-9819-d257d830aeab tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:33.026469 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-668b210e-9b26-415b-9819-d257d830aeab tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:33.189645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-668b210e-9b26-415b-9819-d257d830aeab tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:33.202797 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-668b210e-9b26-415b-9819-d257d830aeab tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1371 microversion: 2.1 time: 0.209147 Aug 18 14:55:33.205219 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 330/592] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:32 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:33.211590 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f4a60e25-b964-4477-8a2b-824fb20fcd01 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:33.214603 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f4a60e25-b964-4477-8a2b-824fb20fcd01 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: 359bcf74-3804-413e-9c13-4fcd166074c1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:33.223202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f4a60e25-b964-4477-8a2b-824fb20fcd01 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:33.223382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f4a60e25-b964-4477-8a2b-824fb20fcd01 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:33.224002 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f4a60e25-b964-4477-8a2b-824fb20fcd01 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:33.224741 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f4a60e25-b964-4477-8a2b-824fb20fcd01 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:33.225585 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f4a60e25-b964-4477-8a2b-824fb20fcd01 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:33.225908 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f4a60e25-b964-4477-8a2b-824fb20fcd01 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:33.379084 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f4a60e25-b964-4477-8a2b-824fb20fcd01 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:33.389068 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f4a60e25-b964-4477-8a2b-824fb20fcd01 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1" status: 200 len: 1318 microversion: 2.1 time: 0.182565 Aug 18 14:55:33.389780 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 331/593] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:33 2022] GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:33.441513 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-059108fb-17bb-43ed-b2d3-3d04a2f6a905 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:33.442718 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-059108fb-17bb-43ed-b2d3-3d04a2f6a905 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:33.450897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-059108fb-17bb-43ed-b2d3-3d04a2f6a905 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:33.451388 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-059108fb-17bb-43ed-b2d3-3d04a2f6a905 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:33.451865 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-059108fb-17bb-43ed-b2d3-3d04a2f6a905 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:33.452564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-059108fb-17bb-43ed-b2d3-3d04a2f6a905 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:33.453140 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-059108fb-17bb-43ed-b2d3-3d04a2f6a905 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:33.453558 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-059108fb-17bb-43ed-b2d3-3d04a2f6a905 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:33.605038 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-059108fb-17bb-43ed-b2d3-3d04a2f6a905 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:33.614336 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-059108fb-17bb-43ed-b2d3-3d04a2f6a905 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1677 microversion: 2.1 time: 0.177253 Aug 18 14:55:33.615324 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 332/594] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:33 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:33.885218 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a39c93b1-cfd4-4688-b944-07044fe2b1b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:33.886159 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a39c93b1-cfd4-4688-b944-07044fe2b1b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:33.892282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a39c93b1-cfd4-4688-b944-07044fe2b1b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:33.892766 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a39c93b1-cfd4-4688-b944-07044fe2b1b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:33.893199 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a39c93b1-cfd4-4688-b944-07044fe2b1b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:33.893903 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a39c93b1-cfd4-4688-b944-07044fe2b1b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:33.894490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a39c93b1-cfd4-4688-b944-07044fe2b1b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:33.894916 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a39c93b1-cfd4-4688-b944-07044fe2b1b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:33.928578 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a39c93b1-cfd4-4688-b944-07044fe2b1b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:33.929064 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a39c93b1-cfd4-4688-b944-07044fe2b1b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:33.929493 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a39c93b1-cfd4-4688-b944-07044fe2b1b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:33.929982 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.objects.instance [None req-a39c93b1-cfd4-4688-b944-07044fe2b1b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lazy-loading 'fault' on Instance uuid aa15c998-af91-4654-9cf6-ee7b4b1da164 {{(pid=132268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:55:33.971341 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a39c93b1-cfd4-4688-b944-07044fe2b1b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:33.979223 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a39c93b1-cfd4-4688-b944-07044fe2b1b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 200 len: 1331 microversion: 2.1 time: 0.099397 Aug 18 14:55:33.980012 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 333/595] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:33 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:34.023424 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-db4e64d6-02ed-4439-af4a-ee15713f2262 req-356dc2ae-7da3-4e4f-af44-060e7eed1201 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "359bcf74-3804-413e-9c13-4fcd166074c1", "tag": "3205617c-7d60-4edf-b381-92f27aad338e"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:55:34.033169 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-db4e64d6-02ed-4439-af4a-ee15713f2262 req-356dc2ae-7da3-4e4f-af44-060e7eed1201 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:34.033663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-db4e64d6-02ed-4439-af4a-ee15713f2262 req-356dc2ae-7da3-4e4f-af44-060e7eed1201 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:34.034158 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-db4e64d6-02ed-4439-af4a-ee15713f2262 req-356dc2ae-7da3-4e4f-af44-060e7eed1201 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:34.046309 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-db4e64d6-02ed-4439-af4a-ee15713f2262 req-356dc2ae-7da3-4e4f-af44-060e7eed1201 service nova] Creating event network-changed:3205617c-7d60-4edf-b381-92f27aad338e for instance 359bcf74-3804-413e-9c13-4fcd166074c1 on hv-cinder-85220 Aug 18 14:55:34.051135 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-db4e64d6-02ed-4439-af4a-ee15713f2262 req-356dc2ae-7da3-4e4f-af44-060e7eed1201 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032356 Aug 18 14:55:34.052084 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 334/596] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:55:34.226893 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b59e0710-0db4-410d-ab1e-a3a8bebc0146 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:34.227594 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b59e0710-0db4-410d-ab1e-a3a8bebc0146 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:34.233833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b59e0710-0db4-410d-ab1e-a3a8bebc0146 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:34.234343 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b59e0710-0db4-410d-ab1e-a3a8bebc0146 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:34.234778 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b59e0710-0db4-410d-ab1e-a3a8bebc0146 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:34.235466 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b59e0710-0db4-410d-ab1e-a3a8bebc0146 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:34.235942 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b59e0710-0db4-410d-ab1e-a3a8bebc0146 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:34.236364 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b59e0710-0db4-410d-ab1e-a3a8bebc0146 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:34.383520 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b59e0710-0db4-410d-ab1e-a3a8bebc0146 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:34.393415 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b59e0710-0db4-410d-ab1e-a3a8bebc0146 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1371 microversion: 2.1 time: 0.171015 Aug 18 14:55:34.394297 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 335/597] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:34 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:34.411662 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c36324a6-816f-4106-8b24-33fa48f76efe tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:34.412496 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c36324a6-816f-4106-8b24-33fa48f76efe tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: 359bcf74-3804-413e-9c13-4fcd166074c1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:34.420059 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c36324a6-816f-4106-8b24-33fa48f76efe tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:34.420705 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c36324a6-816f-4106-8b24-33fa48f76efe tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:34.421303 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c36324a6-816f-4106-8b24-33fa48f76efe tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:34.422146 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c36324a6-816f-4106-8b24-33fa48f76efe tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:34.422765 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c36324a6-816f-4106-8b24-33fa48f76efe tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:34.423270 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c36324a6-816f-4106-8b24-33fa48f76efe tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:34.624983 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c36324a6-816f-4106-8b24-33fa48f76efe tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:34.637070 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c36324a6-816f-4106-8b24-33fa48f76efe tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1" status: 200 len: 1318 microversion: 2.1 time: 0.229253 Aug 18 14:55:34.637677 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 336/598] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:34 2022] GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:34.642334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-6fdd4132-f975-40b1-a062-f166c9569d03 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:34.643113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-6fdd4132-f975-40b1-a062-f166c9569d03 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:34.649338 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6fdd4132-f975-40b1-a062-f166c9569d03 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:34.650040 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6fdd4132-f975-40b1-a062-f166c9569d03 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:34.650636 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6fdd4132-f975-40b1-a062-f166c9569d03 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:34.651487 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6fdd4132-f975-40b1-a062-f166c9569d03 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:34.652145 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6fdd4132-f975-40b1-a062-f166c9569d03 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:34.652733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6fdd4132-f975-40b1-a062-f166c9569d03 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:34.895465 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6fdd4132-f975-40b1-a062-f166c9569d03 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:34.903303 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-6fdd4132-f975-40b1-a062-f166c9569d03 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1677 microversion: 2.1 time: 0.264427 Aug 18 14:55:34.903900 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 337/599] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:34 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1677 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:35.002573 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-578a8205-657d-42d1-b96d-d1ed70a347ab tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:35.003178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-578a8205-657d-42d1-b96d-d1ed70a347ab tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:35.005178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:55:35.011238 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-578a8205-657d-42d1-b96d-d1ed70a347ab tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:35.011803 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-578a8205-657d-42d1-b96d-d1ed70a347ab tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:35.012234 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-578a8205-657d-42d1-b96d-d1ed70a347ab tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:35.012923 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-578a8205-657d-42d1-b96d-d1ed70a347ab tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:35.013374 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-578a8205-657d-42d1-b96d-d1ed70a347ab tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:35.013790 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-578a8205-657d-42d1-b96d-d1ed70a347ab tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:35.029630 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-578a8205-657d-42d1-b96d-d1ed70a347ab tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] HTTP exception thrown: Instance aa15c998-af91-4654-9cf6-ee7b4b1da164 could not be found. Aug 18 14:55:35.031715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-578a8205-657d-42d1-b96d-d1ed70a347ab tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Request method failure captured: Aug 18 14:55:35.031715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 HTTP/1.1 Aug 18 14:55:35.031715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:55:35.031715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:55:35.031715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:55:35.031715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:55:35.031715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:55:35.031715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:55:35.031715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:55:35.031715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:55:35.031715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lH4oIml6txed07XrppfY0Z5jhCeqS9LCxxoulg2eAhfaJ8WphU-pzn12EaO7FXV8VEwOuzjKQEfCBldz9fUbgppMEKJd_VSbDb_aR-Ce__ScpKEICpMOfadH5ZH-EfODQJGUEz0cyaOMRlNct6asFRrMu0s30r91ZjclG___yh0IIw Aug 18 14:55:35.031715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:55:35.031715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:55:35.031715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:55:35.031715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:55:35.031715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:55:35.031715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:55:35.031715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:55:35.031715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:55:35.031715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:55:35.031715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:55:35.033060 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_55c9fe0cbbfa47bca81668c039afc092", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:55:35.033060 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:55:35.033060 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:55:35.033060 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:55:35.033060 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:55:35.033060 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:55:35.033060 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:55:35.033060 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 36dbc938bcd741f2a2b2013b6aa6f008 Aug 18 14:55:35.033060 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:55:35.033060 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:55:35.033060 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance aa15c998-af91-4654-9cf6-ee7b4b1da164 could not be found. Aug 18 14:55:35.033060 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': 'aa15c998-af91-4654-9cf6-ee7b4b1da164'} Aug 18 14:55:35.034795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:55:35.034795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:55:35.034795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:55:35.034795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:55:35.034795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:55:35.034795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:55:35.034795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:55:35.034795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:55:35.034795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:55:35.034795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:55:35.034795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa15c998-af91-4654-9cf6-ee7b4b1da164 could not be found. Aug 18 14:55:35.034795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:55:35.034795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:55:35.034795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:55:35.034795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:55:35.034795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:55:35.034795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:55:35.034795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:55:35.034795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:55:35.034795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:55:35.036314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:55:35.036314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:55:35.036314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:55:35.036314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:55:35.036314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:55:35.036314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:55:35.036314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:55:35.036314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa15c998-af91-4654-9cf6-ee7b4b1da164 could not be found. Aug 18 14:55:35.036314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:55:35.036314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:55:35.036314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:55:35.036314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:55:35.036314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:55:35.036314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:55:35.036314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:55:35.036314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:55:35.036314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa15c998-af91-4654-9cf6-ee7b4b1da164 could not be found. Aug 18 14:55:35.036314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:55:35.038260 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-578a8205-657d-42d1-b96d-d1ed70a347ab tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Returning 404 to user: Instance aa15c998-af91-4654-9cf6-ee7b4b1da164 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:55:35.038260 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-578a8205-657d-42d1-b96d-d1ed70a347ab tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 404 len: 111 microversion: 2.1 time: 0.035805 Aug 18 14:55:35.038260 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 338/600] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:34 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 14:55:35.041976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a013c809-1404-467f-b48a-974938ef86d4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '.version_select at 0x7fb214121940>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:35.067918 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a013c809-1404-467f-b48a-974938ef86d4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-457988654" status: 202 len: 0 microversion: 2.1 time: 0.030002 Aug 18 14:55:35.068496 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 339/601] 10.222.0.36 () {58 vars in 1218 bytes} [Thu Aug 18 14:55:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-457988654 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:55:35.415586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-28083975-0c02-4e61-bbdc-97eec71ba3df tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:35.416629 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-28083975-0c02-4e61-bbdc-97eec71ba3df tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:35.424341 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-28083975-0c02-4e61-bbdc-97eec71ba3df tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:35.424921 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-28083975-0c02-4e61-bbdc-97eec71ba3df tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:35.425368 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-28083975-0c02-4e61-bbdc-97eec71ba3df tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:35.426076 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-28083975-0c02-4e61-bbdc-97eec71ba3df tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:35.426532 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-28083975-0c02-4e61-bbdc-97eec71ba3df tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:35.426958 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-28083975-0c02-4e61-bbdc-97eec71ba3df tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:35.947382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-28083975-0c02-4e61-bbdc-97eec71ba3df tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:35.955966 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-28083975-0c02-4e61-bbdc-97eec71ba3df tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1371 microversion: 2.1 time: 0.545784 Aug 18 14:55:35.956596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 340/602] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:35 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1371 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:35.972346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-dc2e3e3d-05e0-45f3-b70d-a97d89792b16 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:35.972955 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-dc2e3e3d-05e0-45f3-b70d-a97d89792b16 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: 359bcf74-3804-413e-9c13-4fcd166074c1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:35.979350 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dc2e3e3d-05e0-45f3-b70d-a97d89792b16 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:35.979879 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dc2e3e3d-05e0-45f3-b70d-a97d89792b16 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:35.980345 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dc2e3e3d-05e0-45f3-b70d-a97d89792b16 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:35.981033 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dc2e3e3d-05e0-45f3-b70d-a97d89792b16 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:35.981530 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dc2e3e3d-05e0-45f3-b70d-a97d89792b16 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:35.981953 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dc2e3e3d-05e0-45f3-b70d-a97d89792b16 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:36.190655 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-dc2e3e3d-05e0-45f3-b70d-a97d89792b16 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:36.198952 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-dc2e3e3d-05e0-45f3-b70d-a97d89792b16 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1" status: 200 len: 1318 microversion: 2.1 time: 0.241365 Aug 18 14:55:36.199522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 341/603] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:35 2022] GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:36.209147 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ce9664d2-82bd-4666-8d6e-22cddd7d6095 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:36.209147 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ce9664d2-82bd-4666-8d6e-22cddd7d6095 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:36.210627 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ce9664d2-82bd-4666-8d6e-22cddd7d6095 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:36.211235 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ce9664d2-82bd-4666-8d6e-22cddd7d6095 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:36.211573 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ce9664d2-82bd-4666-8d6e-22cddd7d6095 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:36.212327 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ce9664d2-82bd-4666-8d6e-22cddd7d6095 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:36.212781 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ce9664d2-82bd-4666-8d6e-22cddd7d6095 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:36.213204 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ce9664d2-82bd-4666-8d6e-22cddd7d6095 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:36.363435 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ce9664d2-82bd-4666-8d6e-22cddd7d6095 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:36.371740 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-ce9664d2-82bd-4666-8d6e-22cddd7d6095 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1677 microversion: 2.1 time: 0.171208 Aug 18 14:55:36.372308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 342/604] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:36 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:36.376814 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b229cd54-5284-433e-8236-c5a6a2df52a0 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:36.377308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b229cd54-5284-433e-8236-c5a6a2df52a0 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:36.383011 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b229cd54-5284-433e-8236-c5a6a2df52a0 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:36.383504 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b229cd54-5284-433e-8236-c5a6a2df52a0 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:36.383998 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b229cd54-5284-433e-8236-c5a6a2df52a0 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:36.384692 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b229cd54-5284-433e-8236-c5a6a2df52a0 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:36.385407 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b229cd54-5284-433e-8236-c5a6a2df52a0 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:36.385832 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b229cd54-5284-433e-8236-c5a6a2df52a0 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:36.463994 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.objects.instance [None req-b229cd54-5284-433e-8236-c5a6a2df52a0 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lazy-loading 'services' on Instance uuid 89777120-9e0a-40d0-b71d-b73882a1a5e6 {{(pid=132268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:55:36.536654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=100 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:55:36.549945 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b229cd54-5284-433e-8236-c5a6a2df52a0 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "DELETE /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6/os-volume_attachments/31bd0bde-d58f-40fc-87ae-ff1d5cf47d92" status: 202 len: 0 microversion: 2.1 time: 0.176399 Aug 18 14:55:36.550465 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 343/605] 10.222.0.36 () {58 vars in 1416 bytes} [Thu Aug 18 14:55:36 2022] DELETE /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6/os-volume_attachments/31bd0bde-d58f-40fc-87ae-ff1d5cf47d92 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:55:36.559109 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ef95bb07-6a23-4a33-8c4e-dc026e5ce869 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:36.561467 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ef95bb07-6a23-4a33-8c4e-dc026e5ce869 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:36.567662 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ef95bb07-6a23-4a33-8c4e-dc026e5ce869 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:36.568177 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ef95bb07-6a23-4a33-8c4e-dc026e5ce869 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:36.568614 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ef95bb07-6a23-4a33-8c4e-dc026e5ce869 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:36.569821 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ef95bb07-6a23-4a33-8c4e-dc026e5ce869 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:36.570282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ef95bb07-6a23-4a33-8c4e-dc026e5ce869 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:36.570713 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ef95bb07-6a23-4a33-8c4e-dc026e5ce869 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:36.601443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-ef95bb07-6a23-4a33-8c4e-dc026e5ce869 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046361 Aug 18 14:55:36.602333 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 344/606] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Aug 18 14:55:36 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:55:36.975810 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5ca1816b-0f13-4320-bfea-1cd8710f2173 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:36.976428 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-5ca1816b-0f13-4320-bfea-1cd8710f2173 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:36.982408 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5ca1816b-0f13-4320-bfea-1cd8710f2173 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:36.982889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5ca1816b-0f13-4320-bfea-1cd8710f2173 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:36.983320 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5ca1816b-0f13-4320-bfea-1cd8710f2173 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:36.984042 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5ca1816b-0f13-4320-bfea-1cd8710f2173 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:36.984496 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5ca1816b-0f13-4320-bfea-1cd8710f2173 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:36.984919 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5ca1816b-0f13-4320-bfea-1cd8710f2173 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:37.119476 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-5ca1816b-0f13-4320-bfea-1cd8710f2173 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:37.127049 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-5ca1816b-0f13-4320-bfea-1cd8710f2173 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1371 microversion: 2.1 time: 0.155151 Aug 18 14:55:37.127602 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 345/607] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:36 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:37.220890 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-4c68073a-61c9-4807-aa54-850d2a96d17c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:37.221522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-4c68073a-61c9-4807-aa54-850d2a96d17c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: 359bcf74-3804-413e-9c13-4fcd166074c1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:37.228418 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4c68073a-61c9-4807-aa54-850d2a96d17c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:37.228908 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4c68073a-61c9-4807-aa54-850d2a96d17c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:37.229350 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4c68073a-61c9-4807-aa54-850d2a96d17c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:37.230080 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4c68073a-61c9-4807-aa54-850d2a96d17c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:37.230541 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4c68073a-61c9-4807-aa54-850d2a96d17c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:37.230965 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4c68073a-61c9-4807-aa54-850d2a96d17c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:37.364759 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-4c68073a-61c9-4807-aa54-850d2a96d17c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:37.373210 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-4c68073a-61c9-4807-aa54-850d2a96d17c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1" status: 200 len: 1318 microversion: 2.1 time: 0.156903 Aug 18 14:55:37.374153 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 346/608] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:37 2022] GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:37.392888 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3a5289fa-082f-4c8b-90ec-9a293c431b53 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:37.393522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-3a5289fa-082f-4c8b-90ec-9a293c431b53 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:37.399636 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3a5289fa-082f-4c8b-90ec-9a293c431b53 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:37.400159 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3a5289fa-082f-4c8b-90ec-9a293c431b53 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:37.400593 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3a5289fa-082f-4c8b-90ec-9a293c431b53 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:37.401296 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3a5289fa-082f-4c8b-90ec-9a293c431b53 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:37.401833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3a5289fa-082f-4c8b-90ec-9a293c431b53 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:37.402261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3a5289fa-082f-4c8b-90ec-9a293c431b53 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:37.537172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-3a5289fa-082f-4c8b-90ec-9a293c431b53 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:37.545692 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-3a5289fa-082f-4c8b-90ec-9a293c431b53 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1677 microversion: 2.1 time: 0.156600 Aug 18 14:55:37.546302 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 347/609] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:37 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:37.613645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5198fab5-b00a-4a71-a710-9fb91720d96d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:37.616520 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-5198fab5-b00a-4a71-a710-9fb91720d96d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:37.622403 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5198fab5-b00a-4a71-a710-9fb91720d96d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:37.622890 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5198fab5-b00a-4a71-a710-9fb91720d96d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:37.623327 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5198fab5-b00a-4a71-a710-9fb91720d96d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:37.624046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5198fab5-b00a-4a71-a710-9fb91720d96d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:37.624510 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5198fab5-b00a-4a71-a710-9fb91720d96d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:37.624942 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5198fab5-b00a-4a71-a710-9fb91720d96d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:37.655134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-5198fab5-b00a-4a71-a710-9fb91720d96d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045295 Aug 18 14:55:37.655737 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 348/610] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Aug 18 14:55:37 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:55:38.147870 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d3f91aff-ce4e-40ef-a2d5-b39a7535c6c9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:38.148527 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d3f91aff-ce4e-40ef-a2d5-b39a7535c6c9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:38.154866 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d3f91aff-ce4e-40ef-a2d5-b39a7535c6c9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:38.155322 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d3f91aff-ce4e-40ef-a2d5-b39a7535c6c9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:38.155813 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d3f91aff-ce4e-40ef-a2d5-b39a7535c6c9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:38.156517 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d3f91aff-ce4e-40ef-a2d5-b39a7535c6c9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:38.156975 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d3f91aff-ce4e-40ef-a2d5-b39a7535c6c9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:38.157402 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d3f91aff-ce4e-40ef-a2d5-b39a7535c6c9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:38.284968 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d3f91aff-ce4e-40ef-a2d5-b39a7535c6c9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:38.293149 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d3f91aff-ce4e-40ef-a2d5-b39a7535c6c9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1371 microversion: 2.1 time: 0.149276 Aug 18 14:55:38.293702 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 349/611] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:38 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:38.393929 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-201b1b6a-7509-44e5-a7e5-e4681e85dfb6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:38.394531 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-201b1b6a-7509-44e5-a7e5-e4681e85dfb6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: 359bcf74-3804-413e-9c13-4fcd166074c1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:38.400878 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-201b1b6a-7509-44e5-a7e5-e4681e85dfb6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:38.401356 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-201b1b6a-7509-44e5-a7e5-e4681e85dfb6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:38.401784 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-201b1b6a-7509-44e5-a7e5-e4681e85dfb6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:38.402463 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-201b1b6a-7509-44e5-a7e5-e4681e85dfb6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:38.402910 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-201b1b6a-7509-44e5-a7e5-e4681e85dfb6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:38.403324 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-201b1b6a-7509-44e5-a7e5-e4681e85dfb6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:38.540622 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-201b1b6a-7509-44e5-a7e5-e4681e85dfb6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:38.548680 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-201b1b6a-7509-44e5-a7e5-e4681e85dfb6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1" status: 200 len: 1318 microversion: 2.1 time: 0.158345 Aug 18 14:55:38.549257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 350/612] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:38 2022] GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:38.569352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-4074d420-a187-4a39-b55b-a6bdc502c127 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:38.570349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-4074d420-a187-4a39-b55b-a6bdc502c127 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:38.576106 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4074d420-a187-4a39-b55b-a6bdc502c127 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:38.576590 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4074d420-a187-4a39-b55b-a6bdc502c127 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:38.577018 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4074d420-a187-4a39-b55b-a6bdc502c127 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:38.577708 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4074d420-a187-4a39-b55b-a6bdc502c127 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:38.578182 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4074d420-a187-4a39-b55b-a6bdc502c127 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:38.578600 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4074d420-a187-4a39-b55b-a6bdc502c127 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:38.726000 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-4074d420-a187-4a39-b55b-a6bdc502c127 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:38.735883 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-4074d420-a187-4a39-b55b-a6bdc502c127 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1677 microversion: 2.1 time: 0.171649 Aug 18 14:55:38.747702 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 351/613] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:38 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:38.747702 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-47bd5655-8ae4-452e-9720-78092a33c3ef tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:38.747702 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-47bd5655-8ae4-452e-9720-78092a33c3ef tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:38.755979 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-47bd5655-8ae4-452e-9720-78092a33c3ef tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:38.756975 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-47bd5655-8ae4-452e-9720-78092a33c3ef tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:38.757414 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-47bd5655-8ae4-452e-9720-78092a33c3ef tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:38.758113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-47bd5655-8ae4-452e-9720-78092a33c3ef tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:38.758564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-47bd5655-8ae4-452e-9720-78092a33c3ef tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:38.758987 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-47bd5655-8ae4-452e-9720-78092a33c3ef tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:38.791016 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-47bd5655-8ae4-452e-9720-78092a33c3ef tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049629 Aug 18 14:55:38.791591 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 352/614] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Aug 18 14:55:38 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 14:55:38.832129 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-d3ba556a-8ea5-44c9-b9c8-d5224028738f req-d3e415df-e6c8-42b2-95e8-0accc75217bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9163961-387b-4e9b-94a8-9647dde7c208", "name": "network-vif-plugged", "status": "completed", "tag": "e57de99a-4074-41f9-9a26-248196b630ba"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:55:38.856177 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-d3ba556a-8ea5-44c9-b9c8-d5224028738f req-d3e415df-e6c8-42b2-95e8-0accc75217bf service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:38.856177 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-d3ba556a-8ea5-44c9-b9c8-d5224028738f req-d3e415df-e6c8-42b2-95e8-0accc75217bf service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:38.856177 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-d3ba556a-8ea5-44c9-b9c8-d5224028738f req-d3e415df-e6c8-42b2-95e8-0accc75217bf service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:38.856177 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-d3ba556a-8ea5-44c9-b9c8-d5224028738f req-d3e415df-e6c8-42b2-95e8-0accc75217bf service nova] Creating event network-vif-plugged:e57de99a-4074-41f9-9a26-248196b630ba for instance d9163961-387b-4e9b-94a8-9647dde7c208 on hv-cinder-85220 Aug 18 14:55:38.860908 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-d3ba556a-8ea5-44c9-b9c8-d5224028738f req-d3e415df-e6c8-42b2-95e8-0accc75217bf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032362 Aug 18 14:55:38.861724 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 353/615] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:55:38.866838 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-1f15a14a-1345-48a2-ac9d-aeb375ef155e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:38.867423 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-1f15a14a-1345-48a2-ac9d-aeb375ef155e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:38.873582 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1f15a14a-1345-48a2-ac9d-aeb375ef155e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:38.874065 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1f15a14a-1345-48a2-ac9d-aeb375ef155e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:38.874498 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1f15a14a-1345-48a2-ac9d-aeb375ef155e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:38.875189 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1f15a14a-1345-48a2-ac9d-aeb375ef155e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:38.875640 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1f15a14a-1345-48a2-ac9d-aeb375ef155e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:38.876087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1f15a14a-1345-48a2-ac9d-aeb375ef155e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:38.902969 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-1f15a14a-1345-48a2-ac9d-aeb375ef155e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Going to try to terminate instance {{(pid=132268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:55:38.994441 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-1f15a14a-1345-48a2-ac9d-aeb375ef155e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "DELETE /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 204 len: 0 microversion: 2.1 time: 0.131280 Aug 18 14:55:38.995521 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 354/616] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 14:55:38 2022] DELETE /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:55:39.005008 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c2fc6216-244e-4d4c-becc-2cec89c45100 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:39.005722 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c2fc6216-244e-4d4c-becc-2cec89c45100 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:39.012572 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c2fc6216-244e-4d4c-becc-2cec89c45100 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:39.013089 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c2fc6216-244e-4d4c-becc-2cec89c45100 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:39.013522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c2fc6216-244e-4d4c-becc-2cec89c45100 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:39.014220 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c2fc6216-244e-4d4c-becc-2cec89c45100 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:39.014686 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c2fc6216-244e-4d4c-becc-2cec89c45100 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:39.015092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c2fc6216-244e-4d4c-becc-2cec89c45100 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:39.042271 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=2 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:55:39.150674 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c2fc6216-244e-4d4c-becc-2cec89c45100 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:39.158578 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c2fc6216-244e-4d4c-becc-2cec89c45100 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1683 microversion: 2.1 time: 0.158510 Aug 18 14:55:39.159147 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 355/617] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:38 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:39.314060 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-da7e2353-46ec-4a00-b07e-84dafa3bbc72 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:39.314676 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-da7e2353-46ec-4a00-b07e-84dafa3bbc72 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:39.320687 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-da7e2353-46ec-4a00-b07e-84dafa3bbc72 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:39.321173 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-da7e2353-46ec-4a00-b07e-84dafa3bbc72 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:39.321614 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-da7e2353-46ec-4a00-b07e-84dafa3bbc72 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:39.322311 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-da7e2353-46ec-4a00-b07e-84dafa3bbc72 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:39.322770 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-da7e2353-46ec-4a00-b07e-84dafa3bbc72 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:39.323195 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-da7e2353-46ec-4a00-b07e-84dafa3bbc72 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:39.456792 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-da7e2353-46ec-4a00-b07e-84dafa3bbc72 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:39.465685 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-da7e2353-46ec-4a00-b07e-84dafa3bbc72 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1371 microversion: 2.1 time: 0.155454 Aug 18 14:55:39.466393 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 356/618] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:39 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:39.568271 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5f1fb439-9930-4a20-acff-2d2a6932a54c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:39.568879 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-5f1fb439-9930-4a20-acff-2d2a6932a54c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: 359bcf74-3804-413e-9c13-4fcd166074c1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:39.571261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=8 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:55:39.576960 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5f1fb439-9930-4a20-acff-2d2a6932a54c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:39.577434 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5f1fb439-9930-4a20-acff-2d2a6932a54c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:39.577863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5f1fb439-9930-4a20-acff-2d2a6932a54c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:39.578543 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5f1fb439-9930-4a20-acff-2d2a6932a54c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:39.578991 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5f1fb439-9930-4a20-acff-2d2a6932a54c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:39.579408 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5f1fb439-9930-4a20-acff-2d2a6932a54c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:39.709603 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-5f1fb439-9930-4a20-acff-2d2a6932a54c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:39.717220 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-5f1fb439-9930-4a20-acff-2d2a6932a54c tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1" status: 200 len: 1318 microversion: 2.1 time: 0.152837 Aug 18 14:55:39.717780 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 357/619] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:39 2022] GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:39.758970 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-1897abda-78f9-46bf-9aaa-7fa26ae4988f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:39.759513 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-1897abda-78f9-46bf-9aaa-7fa26ae4988f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:39.765545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1897abda-78f9-46bf-9aaa-7fa26ae4988f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:39.766027 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1897abda-78f9-46bf-9aaa-7fa26ae4988f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:39.766457 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1897abda-78f9-46bf-9aaa-7fa26ae4988f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:39.767138 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1897abda-78f9-46bf-9aaa-7fa26ae4988f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:39.767593 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1897abda-78f9-46bf-9aaa-7fa26ae4988f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:39.768041 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1897abda-78f9-46bf-9aaa-7fa26ae4988f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:39.895900 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-1897abda-78f9-46bf-9aaa-7fa26ae4988f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:39.904315 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-1897abda-78f9-46bf-9aaa-7fa26ae4988f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1677 microversion: 2.1 time: 0.149084 Aug 18 14:55:39.904883 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 358/620] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:39 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:40.181019 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-73337acb-d967-414b-935e-6f0b097ef5d5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:40.181751 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-73337acb-d967-414b-935e-6f0b097ef5d5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:40.187633 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-73337acb-d967-414b-935e-6f0b097ef5d5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:40.188153 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-73337acb-d967-414b-935e-6f0b097ef5d5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:40.188563 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-73337acb-d967-414b-935e-6f0b097ef5d5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:40.189239 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-73337acb-d967-414b-935e-6f0b097ef5d5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:40.189685 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-73337acb-d967-414b-935e-6f0b097ef5d5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:40.190101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-73337acb-d967-414b-935e-6f0b097ef5d5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:40.205211 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:55:40.323381 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-73337acb-d967-414b-935e-6f0b097ef5d5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:40.331113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-73337acb-d967-414b-935e-6f0b097ef5d5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1683 microversion: 2.1 time: 0.154585 Aug 18 14:55:40.331698 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 359/621] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:40 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:40.487010 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-61a4d729-6929-4414-8aa7-cf04570c6df5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:40.487620 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-61a4d729-6929-4414-8aa7-cf04570c6df5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:40.494237 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-61a4d729-6929-4414-8aa7-cf04570c6df5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:40.494717 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-61a4d729-6929-4414-8aa7-cf04570c6df5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:40.495150 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-61a4d729-6929-4414-8aa7-cf04570c6df5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:40.495920 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-61a4d729-6929-4414-8aa7-cf04570c6df5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:40.496374 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-61a4d729-6929-4414-8aa7-cf04570c6df5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:40.496794 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-61a4d729-6929-4414-8aa7-cf04570c6df5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:40.627969 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-61a4d729-6929-4414-8aa7-cf04570c6df5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:40.636317 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-61a4d729-6929-4414-8aa7-cf04570c6df5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1371 microversion: 2.1 time: 0.153027 Aug 18 14:55:40.637080 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 360/622] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:40 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:40.738494 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-105554c2-0d4c-441f-b0a3-914c4ebafafd tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:40.739151 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-105554c2-0d4c-441f-b0a3-914c4ebafafd tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: 359bcf74-3804-413e-9c13-4fcd166074c1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:40.745700 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-105554c2-0d4c-441f-b0a3-914c4ebafafd tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:40.746178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-105554c2-0d4c-441f-b0a3-914c4ebafafd tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:40.746610 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-105554c2-0d4c-441f-b0a3-914c4ebafafd tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:40.747327 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-105554c2-0d4c-441f-b0a3-914c4ebafafd tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:40.747804 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-105554c2-0d4c-441f-b0a3-914c4ebafafd tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:40.748225 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-105554c2-0d4c-441f-b0a3-914c4ebafafd tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:40.889246 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-105554c2-0d4c-441f-b0a3-914c4ebafafd tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:40.898984 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-105554c2-0d4c-441f-b0a3-914c4ebafafd tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1" status: 200 len: 1318 microversion: 2.1 time: 0.164258 Aug 18 14:55:40.900553 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 361/623] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:40 2022] GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:40.904960 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-8d1746b5-2e32-4870-b8dc-3179a2e70bac req-6a4757b8-2f8c-4e97-abfd-2a0e1db33fcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "359bcf74-3804-413e-9c13-4fcd166074c1", "name": "network-vif-plugged", "status": "completed", "tag": "3205617c-7d60-4edf-b381-92f27aad338e"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:55:40.914387 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-8d1746b5-2e32-4870-b8dc-3179a2e70bac req-6a4757b8-2f8c-4e97-abfd-2a0e1db33fcb service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:40.914884 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-8d1746b5-2e32-4870-b8dc-3179a2e70bac req-6a4757b8-2f8c-4e97-abfd-2a0e1db33fcb service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:40.915290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-8d1746b5-2e32-4870-b8dc-3179a2e70bac req-6a4757b8-2f8c-4e97-abfd-2a0e1db33fcb service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:40.928528 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-8d1746b5-2e32-4870-b8dc-3179a2e70bac req-6a4757b8-2f8c-4e97-abfd-2a0e1db33fcb service nova] Creating event network-vif-plugged:3205617c-7d60-4edf-b381-92f27aad338e for instance 359bcf74-3804-413e-9c13-4fcd166074c1 on hv-cinder-85220 Aug 18 14:55:40.933331 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-8d1746b5-2e32-4870-b8dc-3179a2e70bac req-6a4757b8-2f8c-4e97-abfd-2a0e1db33fcb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031897 Aug 18 14:55:40.933920 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 362/624] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:55:40.938852 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-aeb061f8-d7c1-48d1-afef-668e5c3a0109 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:40.939543 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-aeb061f8-d7c1-48d1-afef-668e5c3a0109 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:40.946355 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aeb061f8-d7c1-48d1-afef-668e5c3a0109 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:40.946842 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aeb061f8-d7c1-48d1-afef-668e5c3a0109 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:40.947277 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aeb061f8-d7c1-48d1-afef-668e5c3a0109 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:40.947990 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aeb061f8-d7c1-48d1-afef-668e5c3a0109 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:40.948446 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aeb061f8-d7c1-48d1-afef-668e5c3a0109 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:40.948869 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aeb061f8-d7c1-48d1-afef-668e5c3a0109 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:41.105369 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-aeb061f8-d7c1-48d1-afef-668e5c3a0109 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:41.113321 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-aeb061f8-d7c1-48d1-afef-668e5c3a0109 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1654 microversion: 2.1 time: 0.178306 Aug 18 14:55:41.113888 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 363/625] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:40 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1654 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:41.133974 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-73b931d2-fc37-4fde-839d-5b34ae4316a8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:55:41.141735 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-73b931d2-fc37-4fde-839d-5b34ae4316a8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:41.142249 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-73b931d2-fc37-4fde-839d-5b34ae4316a8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:41.142691 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-73b931d2-fc37-4fde-839d-5b34ae4316a8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:41.169208 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-73b931d2-fc37-4fde-839d-5b34ae4316a8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Going to try to start instance {{(pid=132268) start /opt/stack/nova/nova/compute/api.py:2775}} Aug 18 14:55:41.222993 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-73b931d2-fc37-4fde-839d-5b34ae4316a8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "POST /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5/action" status: 202 len: 0 microversion: 2.1 time: 0.092276 Aug 18 14:55:41.223945 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 364/626] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Aug 18 14:55:41 2022] POST /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 14:55:41.233617 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-fd2c7fee-08bd-474a-ab26-12a9b69281a3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:41.234320 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-fd2c7fee-08bd-474a-ab26-12a9b69281a3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:41.240793 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fd2c7fee-08bd-474a-ab26-12a9b69281a3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:41.241284 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fd2c7fee-08bd-474a-ab26-12a9b69281a3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:41.241778 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fd2c7fee-08bd-474a-ab26-12a9b69281a3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:41.242469 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fd2c7fee-08bd-474a-ab26-12a9b69281a3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:41.242956 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fd2c7fee-08bd-474a-ab26-12a9b69281a3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:41.243385 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fd2c7fee-08bd-474a-ab26-12a9b69281a3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:41.374846 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-fd2c7fee-08bd-474a-ab26-12a9b69281a3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:41.383003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-fd2c7fee-08bd-474a-ab26-12a9b69281a3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1663 microversion: 2.1 time: 0.153989 Aug 18 14:55:41.383565 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 365/627] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:41 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:41.388294 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0791e622-fcaf-48de-a7b7-e9f57f2d0212 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:41.388887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0791e622-fcaf-48de-a7b7-e9f57f2d0212 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:41.394447 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0791e622-fcaf-48de-a7b7-e9f57f2d0212 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:41.394921 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0791e622-fcaf-48de-a7b7-e9f57f2d0212 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:41.395346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0791e622-fcaf-48de-a7b7-e9f57f2d0212 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:41.396209 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0791e622-fcaf-48de-a7b7-e9f57f2d0212 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:41.396660 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0791e622-fcaf-48de-a7b7-e9f57f2d0212 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:41.397611 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0791e622-fcaf-48de-a7b7-e9f57f2d0212 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:41.530592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-0791e622-fcaf-48de-a7b7-e9f57f2d0212 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:41.538924 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0791e622-fcaf-48de-a7b7-e9f57f2d0212 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1683 microversion: 2.1 time: 0.154345 Aug 18 14:55:41.539478 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 366/628] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:41 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:41.658119 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a1a12f25-5655-4fcc-b8ee-79ec143cfbb3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:41.658726 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a1a12f25-5655-4fcc-b8ee-79ec143cfbb3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:41.666083 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a1a12f25-5655-4fcc-b8ee-79ec143cfbb3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:41.666694 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a1a12f25-5655-4fcc-b8ee-79ec143cfbb3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:41.667128 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a1a12f25-5655-4fcc-b8ee-79ec143cfbb3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:41.667847 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a1a12f25-5655-4fcc-b8ee-79ec143cfbb3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:41.668298 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a1a12f25-5655-4fcc-b8ee-79ec143cfbb3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:41.668717 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a1a12f25-5655-4fcc-b8ee-79ec143cfbb3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:41.797825 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a1a12f25-5655-4fcc-b8ee-79ec143cfbb3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:41.805564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a1a12f25-5655-4fcc-b8ee-79ec143cfbb3 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1371 microversion: 2.1 time: 0.151312 Aug 18 14:55:41.806141 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 367/629] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:41 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:41.920292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-92c276a1-d5bf-4c5d-b7c5-fd2689ba843a tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:41.920905 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-92c276a1-d5bf-4c5d-b7c5-fd2689ba843a tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: 359bcf74-3804-413e-9c13-4fcd166074c1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:41.926998 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-92c276a1-d5bf-4c5d-b7c5-fd2689ba843a tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:41.927482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-92c276a1-d5bf-4c5d-b7c5-fd2689ba843a tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:41.927948 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-92c276a1-d5bf-4c5d-b7c5-fd2689ba843a tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:41.928671 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-92c276a1-d5bf-4c5d-b7c5-fd2689ba843a tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:41.929123 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-92c276a1-d5bf-4c5d-b7c5-fd2689ba843a tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:41.929547 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-92c276a1-d5bf-4c5d-b7c5-fd2689ba843a tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:42.064399 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-92c276a1-d5bf-4c5d-b7c5-fd2689ba843a tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:42.074528 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-92c276a1-d5bf-4c5d-b7c5-fd2689ba843a tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1" status: 200 len: 1318 microversion: 2.1 time: 0.158050 Aug 18 14:55:42.075776 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 368/630] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:41 2022] GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:42.395788 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-242ec6e6-edcd-45a4-92a0-36278a23f43f req-c0fd9141-9034-46ae-aacb-fe76c332ea6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89777120-9e0a-40d0-b71d-b73882a1a5e6", "name": "network-vif-deleted", "tag": "7a3ee760-5357-4d9d-8a5c-1bb9ef667c23"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:55:42.405597 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-242ec6e6-edcd-45a4-92a0-36278a23f43f req-c0fd9141-9034-46ae-aacb-fe76c332ea6a service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:42.406068 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-242ec6e6-edcd-45a4-92a0-36278a23f43f req-c0fd9141-9034-46ae-aacb-fe76c332ea6a service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:42.406558 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-242ec6e6-edcd-45a4-92a0-36278a23f43f req-c0fd9141-9034-46ae-aacb-fe76c332ea6a service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:42.418695 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-242ec6e6-edcd-45a4-92a0-36278a23f43f req-c0fd9141-9034-46ae-aacb-fe76c332ea6a service nova] Creating event network-vif-deleted:7a3ee760-5357-4d9d-8a5c-1bb9ef667c23 for instance 89777120-9e0a-40d0-b71d-b73882a1a5e6 on hv-cinder-85220 Aug 18 14:55:42.423573 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-242ec6e6-edcd-45a4-92a0-36278a23f43f req-c0fd9141-9034-46ae-aacb-fe76c332ea6a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031466 Aug 18 14:55:42.424480 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 369/631] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:55:42.431719 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3ab5ba58-664a-4554-8969-01f40b6e97c3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:42.432624 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-3ab5ba58-664a-4554-8969-01f40b6e97c3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:42.438941 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3ab5ba58-664a-4554-8969-01f40b6e97c3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:42.439423 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3ab5ba58-664a-4554-8969-01f40b6e97c3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:42.440169 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3ab5ba58-664a-4554-8969-01f40b6e97c3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:42.440998 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3ab5ba58-664a-4554-8969-01f40b6e97c3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:42.441711 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3ab5ba58-664a-4554-8969-01f40b6e97c3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:42.442296 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3ab5ba58-664a-4554-8969-01f40b6e97c3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:42.594343 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-3ab5ba58-664a-4554-8969-01f40b6e97c3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:42.603528 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-3ab5ba58-664a-4554-8969-01f40b6e97c3 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1663 microversion: 2.1 time: 0.176040 Aug 18 14:55:42.615742 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 370/632] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:42 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1663 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:42.615742 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5b7dac5f-ce58-435f-b0de-76559f055d81 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:42.615742 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-5b7dac5f-ce58-435f-b0de-76559f055d81 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:42.621059 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5b7dac5f-ce58-435f-b0de-76559f055d81 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:42.621937 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5b7dac5f-ce58-435f-b0de-76559f055d81 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:42.622887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5b7dac5f-ce58-435f-b0de-76559f055d81 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:42.623786 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5b7dac5f-ce58-435f-b0de-76559f055d81 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:42.624518 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5b7dac5f-ce58-435f-b0de-76559f055d81 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:42.624981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5b7dac5f-ce58-435f-b0de-76559f055d81 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:42.710583 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-5b7dac5f-ce58-435f-b0de-76559f055d81 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:42.721328 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-5b7dac5f-ce58-435f-b0de-76559f055d81 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1615 microversion: 2.1 time: 0.116016 Aug 18 14:55:42.722268 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 371/633] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:42 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1615 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:42.830173 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-08f51b76-d07b-40be-8178-5d097e780ac6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:42.831285 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-08f51b76-d07b-40be-8178-5d097e780ac6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:42.838628 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-08f51b76-d07b-40be-8178-5d097e780ac6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:42.839207 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-08f51b76-d07b-40be-8178-5d097e780ac6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:42.839742 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-08f51b76-d07b-40be-8178-5d097e780ac6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:42.840453 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-08f51b76-d07b-40be-8178-5d097e780ac6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:42.840909 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-08f51b76-d07b-40be-8178-5d097e780ac6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:42.841334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-08f51b76-d07b-40be-8178-5d097e780ac6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:42.984137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-08f51b76-d07b-40be-8178-5d097e780ac6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:42.991804 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-08f51b76-d07b-40be-8178-5d097e780ac6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1564 microversion: 2.1 time: 0.167418 Aug 18 14:55:42.992358 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 372/634] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:42 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1564 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:43.014741 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-7ca087e2-b2e4-4ddf-a0da-f98549d62c8c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:43.015242 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-7ca087e2-b2e4-4ddf-a0da-f98549d62c8c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:43.021334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7ca087e2-b2e4-4ddf-a0da-f98549d62c8c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:43.022365 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7ca087e2-b2e4-4ddf-a0da-f98549d62c8c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:43.022815 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7ca087e2-b2e4-4ddf-a0da-f98549d62c8c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:43.023512 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7ca087e2-b2e4-4ddf-a0da-f98549d62c8c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:43.023996 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7ca087e2-b2e4-4ddf-a0da-f98549d62c8c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:43.024427 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7ca087e2-b2e4-4ddf-a0da-f98549d62c8c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:43.104667 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-7ca087e2-b2e4-4ddf-a0da-f98549d62c8c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094458 Aug 18 14:55:43.105265 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 373/635] 10.222.0.36 () {58 vars in 1275 bytes} [Thu Aug 18 14:55:43 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:55:43.111966 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-64e53c40-3dc4-4702-9c81-503773703025 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:43.111966 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-64e53c40-3dc4-4702-9c81-503773703025 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: 359bcf74-3804-413e-9c13-4fcd166074c1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:43.117247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-64e53c40-3dc4-4702-9c81-503773703025 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:43.117669 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-64e53c40-3dc4-4702-9c81-503773703025 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:43.118106 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-64e53c40-3dc4-4702-9c81-503773703025 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:43.118916 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-64e53c40-3dc4-4702-9c81-503773703025 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:43.119364 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-64e53c40-3dc4-4702-9c81-503773703025 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:43.119666 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-64e53c40-3dc4-4702-9c81-503773703025 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:43.437236 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-64e53c40-3dc4-4702-9c81-503773703025 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:43.445465 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-64e53c40-3dc4-4702-9c81-503773703025 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1" status: 200 len: 1318 microversion: 2.1 time: 0.339032 Aug 18 14:55:43.446048 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 374/636] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:43 2022] GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:43.624968 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-9bec3f5d-ed23-421d-9b56-d7e6e0684d73 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:43.625597 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-9bec3f5d-ed23-421d-9b56-d7e6e0684d73 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:43.631738 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9bec3f5d-ed23-421d-9b56-d7e6e0684d73 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:43.632229 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9bec3f5d-ed23-421d-9b56-d7e6e0684d73 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:43.632655 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9bec3f5d-ed23-421d-9b56-d7e6e0684d73 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:43.633343 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9bec3f5d-ed23-421d-9b56-d7e6e0684d73 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:43.633794 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9bec3f5d-ed23-421d-9b56-d7e6e0684d73 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:43.634210 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9bec3f5d-ed23-421d-9b56-d7e6e0684d73 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:43.883965 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-9bec3f5d-ed23-421d-9b56-d7e6e0684d73 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:43.891920 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-9bec3f5d-ed23-421d-9b56-d7e6e0684d73 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1663 microversion: 2.1 time: 0.271144 Aug 18 14:55:43.892891 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 375/637] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:43 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1663 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:43.898762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-efd335df-ccab-49cf-9a32-6d56ddc63e41 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:43.899365 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-efd335df-ccab-49cf-9a32-6d56ddc63e41 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:43.905765 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-efd335df-ccab-49cf-9a32-6d56ddc63e41 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:43.906246 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-efd335df-ccab-49cf-9a32-6d56ddc63e41 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:43.906676 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-efd335df-ccab-49cf-9a32-6d56ddc63e41 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:43.907367 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-efd335df-ccab-49cf-9a32-6d56ddc63e41 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:43.907859 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-efd335df-ccab-49cf-9a32-6d56ddc63e41 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:43.908282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-efd335df-ccab-49cf-9a32-6d56ddc63e41 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:43.961145 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-efd335df-ccab-49cf-9a32-6d56ddc63e41 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:43.961628 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-efd335df-ccab-49cf-9a32-6d56ddc63e41 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:43.962413 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-efd335df-ccab-49cf-9a32-6d56ddc63e41 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:43.962551 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.objects.instance [None req-efd335df-ccab-49cf-9a32-6d56ddc63e41 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lazy-loading 'fault' on Instance uuid 89777120-9e0a-40d0-b71d-b73882a1a5e6 {{(pid=132268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:55:43.965495 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:55:44.027885 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-efd335df-ccab-49cf-9a32-6d56ddc63e41 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:44.036632 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-efd335df-ccab-49cf-9a32-6d56ddc63e41 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 200 len: 1331 microversion: 2.1 time: 0.141427 Aug 18 14:55:44.037915 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 376/638] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:43 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 1331 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:44.304474 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-589f1ebf-8b16-4777-bade-343a386be2cc req-c8ca994d-e993-4ded-9115-6b8629147d1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9163961-387b-4e9b-94a8-9647dde7c208", "tag": "e57de99a-4074-41f9-9a26-248196b630ba"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:55:44.314157 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-589f1ebf-8b16-4777-bade-343a386be2cc req-c8ca994d-e993-4ded-9115-6b8629147d1e service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:44.314625 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-589f1ebf-8b16-4777-bade-343a386be2cc req-c8ca994d-e993-4ded-9115-6b8629147d1e service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:44.315048 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-589f1ebf-8b16-4777-bade-343a386be2cc req-c8ca994d-e993-4ded-9115-6b8629147d1e service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:44.326624 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-589f1ebf-8b16-4777-bade-343a386be2cc req-c8ca994d-e993-4ded-9115-6b8629147d1e service nova] Creating event network-changed:e57de99a-4074-41f9-9a26-248196b630ba for instance d9163961-387b-4e9b-94a8-9647dde7c208 on hv-cinder-85220 Aug 18 14:55:44.332826 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-589f1ebf-8b16-4777-bade-343a386be2cc req-c8ca994d-e993-4ded-9115-6b8629147d1e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032629 Aug 18 14:55:44.333744 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 377/639] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:55:44.467972 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-1fe06dd5-3809-4469-bf36-15c4f36ea51b tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:44.468753 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-1fe06dd5-3809-4469-bf36-15c4f36ea51b tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: 359bcf74-3804-413e-9c13-4fcd166074c1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:44.476169 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1fe06dd5-3809-4469-bf36-15c4f36ea51b tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:44.476666 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1fe06dd5-3809-4469-bf36-15c4f36ea51b tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:44.477102 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1fe06dd5-3809-4469-bf36-15c4f36ea51b tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:44.477814 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1fe06dd5-3809-4469-bf36-15c4f36ea51b tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:44.478272 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1fe06dd5-3809-4469-bf36-15c4f36ea51b tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:44.478702 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1fe06dd5-3809-4469-bf36-15c4f36ea51b tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:44.612315 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-1fe06dd5-3809-4469-bf36-15c4f36ea51b tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:44.621111 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-1fe06dd5-3809-4469-bf36-15c4f36ea51b tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1" status: 200 len: 1508 microversion: 2.1 time: 0.158349 Aug 18 14:55:44.621795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 378/640] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:44 2022] GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:44.642458 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-4b4d1a80-1560-4533-a134-f9f51811a7b6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "feecdb0d-b490-489d-9a8d-405361bafc77", "device": "/dev/sdb"}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:55:44.645718 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-4b4d1a80-1560-4533-a134-f9f51811a7b6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: 359bcf74-3804-413e-9c13-4fcd166074c1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:44.651876 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4b4d1a80-1560-4533-a134-f9f51811a7b6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:44.652365 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4b4d1a80-1560-4533-a134-f9f51811a7b6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:44.652799 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4b4d1a80-1560-4533-a134-f9f51811a7b6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:44.653495 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4b4d1a80-1560-4533-a134-f9f51811a7b6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:44.653952 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4b4d1a80-1560-4533-a134-f9f51811a7b6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:44.654379 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4b4d1a80-1560-4533-a134-f9f51811a7b6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:45.422983 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-4b4d1a80-1560-4533-a134-f9f51811a7b6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "POST /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.784129 Aug 18 14:55:45.441921 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 379/641] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Aug 18 14:55:44 2022] POST /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1/os-volume_attachments => generated 194 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:55:45.457466 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-520f951a-9653-45a4-9672-7fd8f0a57181 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:45.458618 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-520f951a-9653-45a4-9672-7fd8f0a57181 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:45.474249 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-520f951a-9653-45a4-9672-7fd8f0a57181 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:45.477317 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-520f951a-9653-45a4-9672-7fd8f0a57181 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:45.477967 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-520f951a-9653-45a4-9672-7fd8f0a57181 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:45.480091 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-520f951a-9653-45a4-9672-7fd8f0a57181 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:45.481006 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-520f951a-9653-45a4-9672-7fd8f0a57181 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:45.482529 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-520f951a-9653-45a4-9672-7fd8f0a57181 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:45.915892 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-520f951a-9653-45a4-9672-7fd8f0a57181 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:45.924340 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-520f951a-9653-45a4-9672-7fd8f0a57181 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1663 microversion: 2.1 time: 0.478687 Aug 18 14:55:45.924968 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 380/642] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:45 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1663 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:45.930590 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f2ce8d11-573f-4f08-8f09-94dba260b1d7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:45.931609 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f2ce8d11-573f-4f08-8f09-94dba260b1d7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:45.937464 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f2ce8d11-573f-4f08-8f09-94dba260b1d7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:45.937942 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f2ce8d11-573f-4f08-8f09-94dba260b1d7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:45.938369 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f2ce8d11-573f-4f08-8f09-94dba260b1d7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:45.939057 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f2ce8d11-573f-4f08-8f09-94dba260b1d7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:45.939578 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f2ce8d11-573f-4f08-8f09-94dba260b1d7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:45.939940 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f2ce8d11-573f-4f08-8f09-94dba260b1d7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:45.954202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-f2ce8d11-573f-4f08-8f09-94dba260b1d7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] HTTP exception thrown: Instance 89777120-9e0a-40d0-b71d-b73882a1a5e6 could not be found. Aug 18 14:55:45.956308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f2ce8d11-573f-4f08-8f09-94dba260b1d7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Request method failure captured: Aug 18 14:55:45.956308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 HTTP/1.1 Aug 18 14:55:45.956308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:55:45.956308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:55:45.956308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:55:45.956308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:55:45.956308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:55:45.956308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:55:45.956308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:55:45.956308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:55:45.956308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lH4oIml6txed07XrppfY0Z5jhCeqS9LCxxoulg2eAhfaJ8WphU-pzn12EaO7FXV8VEwOuzjKQEfCBldz9fUbgppMEKJd_VSbDb_aR-Ce__ScpKEICpMOfadH5ZH-EfODQJGUEz0cyaOMRlNct6asFRrMu0s30r91ZjclG___yh0IIw Aug 18 14:55:45.956308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:55:45.956308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:55:45.956308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:55:45.956308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:55:45.956308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:55:45.956308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:55:45.956308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:55:45.956308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:55:45.956308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:55:45.956308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:55:45.957756 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_55c9fe0cbbfa47bca81668c039afc092", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:55:45.957756 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:55:45.957756 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:55:45.957756 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:55:45.957756 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:55:45.957756 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:55:45.957756 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:55:45.957756 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 36dbc938bcd741f2a2b2013b6aa6f008 Aug 18 14:55:45.957756 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:55:45.957756 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:55:45.957756 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 89777120-9e0a-40d0-b71d-b73882a1a5e6 could not be found. Aug 18 14:55:45.957756 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '89777120-9e0a-40d0-b71d-b73882a1a5e6'} Aug 18 14:55:45.958586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:55:45.958586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:55:45.958586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:55:45.958586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:55:45.958586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:55:45.958586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:55:45.958586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:55:45.958586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:55:45.958586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:55:45.958586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:55:45.958586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89777120-9e0a-40d0-b71d-b73882a1a5e6 could not be found. Aug 18 14:55:45.958586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:55:45.958586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:55:45.958586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:55:45.958586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:55:45.958586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:55:45.958586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:55:45.958586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:55:45.958586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:55:45.958586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:55:45.960202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:55:45.960202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:55:45.960202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:55:45.960202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:55:45.960202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:55:45.960202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:55:45.960202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:55:45.960202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89777120-9e0a-40d0-b71d-b73882a1a5e6 could not be found. Aug 18 14:55:45.960202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:55:45.960202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:55:45.960202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:55:45.960202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:55:45.960202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:55:45.960202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:55:45.960202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:55:45.960202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:55:45.960202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89777120-9e0a-40d0-b71d-b73882a1a5e6 could not be found. Aug 18 14:55:45.960202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:55:45.961474 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f2ce8d11-573f-4f08-8f09-94dba260b1d7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Returning 404 to user: Instance 89777120-9e0a-40d0-b71d-b73882a1a5e6 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:55:45.961474 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f2ce8d11-573f-4f08-8f09-94dba260b1d7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 404 len: 111 microversion: 2.1 time: 0.032057 Aug 18 14:55:45.961474 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 381/643] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:45 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:55:45.966712 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3bfe584b-7d11-44ba-8077-c49394f92486 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '.version_select at 0x7fb2140cc430>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:45.979137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:55:45.988815 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-3bfe584b-7d11-44ba-8077-c49394f92486 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-390130781" status: 202 len: 0 microversion: 2.1 time: 0.025478 Aug 18 14:55:45.989631 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 382/644] 10.222.0.36 () {58 vars in 1218 bytes} [Thu Aug 18 14:55:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-390130781 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 14:55:46.645614 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-579a710b-dedc-400e-a08a-33944ba32052 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Action: 'create', calling method: .version_select at 0x7fb2140df9d0>, body: {"keypair": {"name": "tempest-keypair-1804566728", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhnrLxBmB0x54yGCdV85XiX715GIY9rEXYed81ZQbVYusAAlPKsHuNvqEqfwKy3JfKS6yw9pCgT7YRFcwlGtO/+hy7mrymzN1BXwHy4rtRZBbRgMpV5AyjCcCNDI0XLrg=="}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:55:46.663129 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-579a710b-dedc-400e-a08a-33944ba32052 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Getting quotas for project 55c9fe0cbbfa47bca81668c039afc092. Resources: {'key_pairs'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:55:46.666970 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-579a710b-dedc-400e-a08a-33944ba32052 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Getting quotas for user 36dbc938bcd741f2a2b2013b6aa6f008 and project 55c9fe0cbbfa47bca81668c039afc092. Resources: {'key_pairs'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:55:46.692364 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-579a710b-dedc-400e-a08a-33944ba32052 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051116 Aug 18 14:55:46.692982 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 383/645] 10.222.0.36 () {60 vars in 1159 bytes} [Thu Aug 18 14:55:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:55:46.950619 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e2d5a0f6-fd90-4326-b10a-3397889115d8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:46.952007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e2d5a0f6-fd90-4326-b10a-3397889115d8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:46.961628 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e2d5a0f6-fd90-4326-b10a-3397889115d8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:46.962266 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e2d5a0f6-fd90-4326-b10a-3397889115d8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:46.962760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e2d5a0f6-fd90-4326-b10a-3397889115d8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:46.964607 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e2d5a0f6-fd90-4326-b10a-3397889115d8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:46.966132 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e2d5a0f6-fd90-4326-b10a-3397889115d8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:46.966952 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e2d5a0f6-fd90-4326-b10a-3397889115d8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:47.114310 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e2d5a0f6-fd90-4326-b10a-3397889115d8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:47.123650 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e2d5a0f6-fd90-4326-b10a-3397889115d8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1667 microversion: 2.1 time: 0.177520 Aug 18 14:55:47.124543 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 384/646] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:46 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1667 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:48.208737 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5540ab98-bbbf-411c-91aa-a6e0cbdc1ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1669085618", "imageRef": "4083d76b-6b95-4ed8-8053-69a1270afbd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93c9a460-c99c-4e1d-ba82-dd7168d9fd6a"}], "security_groups": [{"name": "tempest-securitygroup--856661489"}], "key_name": "tempest-keypair-1804566728", "user_data": "}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:55:48.314081 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.network.neutron [None req-5540ab98-bbbf-411c-91aa-a6e0cbdc1ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] validate_networks() for [('93c9a460-c99c-4e1d-ba82-dd7168d9fd6a', None, None, None, None, None)] {{(pid=132268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:55:48.687394 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-5540ab98-bbbf-411c-91aa-a6e0cbdc1ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Flavor limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:55:48.687861 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-5540ab98-bbbf-411c-91aa-a6e0cbdc1ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Image limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:55:48.688470 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-5540ab98-bbbf-411c-91aa-a6e0cbdc1ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Flavor pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:55:48.688888 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-5540ab98-bbbf-411c-91aa-a6e0cbdc1ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Image pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:55:48.689301 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-5540ab98-bbbf-411c-91aa-a6e0cbdc1ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:55:48.698169 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5540ab98-bbbf-411c-91aa-a6e0cbdc1ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:48.698640 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5540ab98-bbbf-411c-91aa-a6e0cbdc1ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:48.699064 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5540ab98-bbbf-411c-91aa-a6e0cbdc1ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:48.699823 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5540ab98-bbbf-411c-91aa-a6e0cbdc1ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:48.700275 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5540ab98-bbbf-411c-91aa-a6e0cbdc1ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:48.700702 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5540ab98-bbbf-411c-91aa-a6e0cbdc1ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:48.717111 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-5540ab98-bbbf-411c-91aa-a6e0cbdc1ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Getting quotas for project 55c9fe0cbbfa47bca81668c039afc092. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:55:48.721078 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-5540ab98-bbbf-411c-91aa-a6e0cbdc1ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Getting quotas for user 36dbc938bcd741f2a2b2013b6aa6f008 and project 55c9fe0cbbfa47bca81668c039afc092. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:55:48.732759 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-5540ab98-bbbf-411c-91aa-a6e0cbdc1ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Going to run 1 instances... {{(pid=132268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:55:48.735064 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-5540ab98-bbbf-411c-91aa-a6e0cbdc1ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4083d76b-6b95-4ed8-8053-69a1270afbd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:55:48.782783 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-5540ab98-bbbf-411c-91aa-a6e0cbdc1ca8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.578275 Aug 18 14:55:48.783456 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 385/647] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Aug 18 14:55:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:55:48.794633 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-636231e6-aa9e-4fb7-9e3b-c45d3fd467a2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:48.795249 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-636231e6-aa9e-4fb7-9e3b-c45d3fd467a2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:48.852942 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-636231e6-aa9e-4fb7-9e3b-c45d3fd467a2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:48.859844 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-636231e6-aa9e-4fb7-9e3b-c45d3fd467a2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf" status: 200 len: 1242 microversion: 2.1 time: 0.068920 Aug 18 14:55:48.860405 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 386/648] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:48 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:49.880737 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8a63b196-49d4-4b69-98f2-0b01880d3216 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:49.882722 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-8a63b196-49d4-4b69-98f2-0b01880d3216 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:49.889669 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8a63b196-49d4-4b69-98f2-0b01880d3216 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:49.890152 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8a63b196-49d4-4b69-98f2-0b01880d3216 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:49.890587 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8a63b196-49d4-4b69-98f2-0b01880d3216 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:49.891280 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8a63b196-49d4-4b69-98f2-0b01880d3216 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:49.891760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8a63b196-49d4-4b69-98f2-0b01880d3216 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:49.892188 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8a63b196-49d4-4b69-98f2-0b01880d3216 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:50.001886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8a63b196-49d4-4b69-98f2-0b01880d3216 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:50.009503 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-8a63b196-49d4-4b69-98f2-0b01880d3216 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf" status: 200 len: 1302 microversion: 2.1 time: 0.133060 Aug 18 14:55:50.010884 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 387/649] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:49 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf => generated 1302 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:51.034038 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-637f0828-3050-45fb-ad4c-07a4b8cf718a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:51.034659 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-637f0828-3050-45fb-ad4c-07a4b8cf718a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:51.041657 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-637f0828-3050-45fb-ad4c-07a4b8cf718a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:51.042140 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-637f0828-3050-45fb-ad4c-07a4b8cf718a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:51.042578 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-637f0828-3050-45fb-ad4c-07a4b8cf718a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:51.043267 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-637f0828-3050-45fb-ad4c-07a4b8cf718a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:51.043781 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-637f0828-3050-45fb-ad4c-07a4b8cf718a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:51.044205 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-637f0828-3050-45fb-ad4c-07a4b8cf718a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:51.273585 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-637f0828-3050-45fb-ad4c-07a4b8cf718a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:51.281297 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-637f0828-3050-45fb-ad4c-07a4b8cf718a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf" status: 200 len: 1367 microversion: 2.1 time: 0.251229 Aug 18 14:55:51.281868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 388/650] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:51 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:51.390855 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-bb1002cc-9bde-457b-86a0-68d217c0548f req-66b2ec80-8035-48b4-924b-1c56f56970a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0423b68b-575f-459e-a227-32d920e325cf", "tag": "233ce2fc-4700-4dcf-9eae-52ea3d8932d3"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:55:51.404524 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-bb1002cc-9bde-457b-86a0-68d217c0548f req-66b2ec80-8035-48b4-924b-1c56f56970a7 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:51.405150 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-bb1002cc-9bde-457b-86a0-68d217c0548f req-66b2ec80-8035-48b4-924b-1c56f56970a7 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:51.406428 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-bb1002cc-9bde-457b-86a0-68d217c0548f req-66b2ec80-8035-48b4-924b-1c56f56970a7 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:51.419320 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-bb1002cc-9bde-457b-86a0-68d217c0548f req-66b2ec80-8035-48b4-924b-1c56f56970a7 service nova] Creating event network-changed:233ce2fc-4700-4dcf-9eae-52ea3d8932d3 for instance 0423b68b-575f-459e-a227-32d920e325cf on hv-cinder-85220 Aug 18 14:55:51.424580 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-bb1002cc-9bde-457b-86a0-68d217c0548f req-66b2ec80-8035-48b4-924b-1c56f56970a7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037499 Aug 18 14:55:51.425201 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 389/651] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:55:52.303766 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-33ff1835-ba13-4d44-a578-6fb107682052 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:52.304483 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-33ff1835-ba13-4d44-a578-6fb107682052 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:52.311312 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-33ff1835-ba13-4d44-a578-6fb107682052 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:52.311826 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-33ff1835-ba13-4d44-a578-6fb107682052 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:52.312255 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-33ff1835-ba13-4d44-a578-6fb107682052 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:52.312949 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-33ff1835-ba13-4d44-a578-6fb107682052 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:52.313404 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-33ff1835-ba13-4d44-a578-6fb107682052 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:52.313862 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-33ff1835-ba13-4d44-a578-6fb107682052 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:52.443991 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-33ff1835-ba13-4d44-a578-6fb107682052 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:52.451637 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-33ff1835-ba13-4d44-a578-6fb107682052 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf" status: 200 len: 1367 microversion: 2.1 time: 0.152730 Aug 18 14:55:52.452234 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 390/652] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:52 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:53.473925 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-1c0b8e14-225b-4dfb-a758-ab9a6b46fe39 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:53.474690 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-1c0b8e14-225b-4dfb-a758-ab9a6b46fe39 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:53.481119 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1c0b8e14-225b-4dfb-a758-ab9a6b46fe39 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:53.481595 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1c0b8e14-225b-4dfb-a758-ab9a6b46fe39 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:53.482024 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1c0b8e14-225b-4dfb-a758-ab9a6b46fe39 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:53.482705 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1c0b8e14-225b-4dfb-a758-ab9a6b46fe39 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:53.483184 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1c0b8e14-225b-4dfb-a758-ab9a6b46fe39 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:53.483601 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1c0b8e14-225b-4dfb-a758-ab9a6b46fe39 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:53.660652 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-1c0b8e14-225b-4dfb-a758-ab9a6b46fe39 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:53.668451 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-1c0b8e14-225b-4dfb-a758-ab9a6b46fe39 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf" status: 200 len: 1367 microversion: 2.1 time: 0.199086 Aug 18 14:55:53.669021 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 391/653] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:53 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:55:54.689555 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-21883fff-058c-403a-8772-64d6c19a2522 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:54.690242 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-21883fff-058c-403a-8772-64d6c19a2522 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:54.696812 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-21883fff-058c-403a-8772-64d6c19a2522 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:54.697294 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-21883fff-058c-403a-8772-64d6c19a2522 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:54.697728 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-21883fff-058c-403a-8772-64d6c19a2522 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:54.698783 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-21883fff-058c-403a-8772-64d6c19a2522 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:54.699249 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-21883fff-058c-403a-8772-64d6c19a2522 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:54.699694 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-21883fff-058c-403a-8772-64d6c19a2522 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:54.839931 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-21883fff-058c-403a-8772-64d6c19a2522 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:54.847748 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-21883fff-058c-403a-8772-64d6c19a2522 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf" status: 200 len: 1367 microversion: 2.1 time: 0.162009 Aug 18 14:55:54.848338 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 392/654] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:54 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:55.870417 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f9008f92-2cdd-4f96-a9c3-1b22aecab730 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:55.871193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f9008f92-2cdd-4f96-a9c3-1b22aecab730 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:55.877448 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f9008f92-2cdd-4f96-a9c3-1b22aecab730 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:55.877939 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f9008f92-2cdd-4f96-a9c3-1b22aecab730 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:55.878360 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f9008f92-2cdd-4f96-a9c3-1b22aecab730 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:55.879041 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f9008f92-2cdd-4f96-a9c3-1b22aecab730 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:55.879493 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f9008f92-2cdd-4f96-a9c3-1b22aecab730 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:55.879939 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f9008f92-2cdd-4f96-a9c3-1b22aecab730 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:56.012754 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f9008f92-2cdd-4f96-a9c3-1b22aecab730 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:56.020395 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f9008f92-2cdd-4f96-a9c3-1b22aecab730 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf" status: 200 len: 1367 microversion: 2.1 time: 0.153933 Aug 18 14:55:56.020954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 393/655] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:55 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:57.041963 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8ce9ee01-4b31-43a5-891f-d81ec65d17c8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:57.042652 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-8ce9ee01-4b31-43a5-891f-d81ec65d17c8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:57.049127 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8ce9ee01-4b31-43a5-891f-d81ec65d17c8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:57.049599 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8ce9ee01-4b31-43a5-891f-d81ec65d17c8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:57.050026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8ce9ee01-4b31-43a5-891f-d81ec65d17c8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:57.050702 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8ce9ee01-4b31-43a5-891f-d81ec65d17c8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:57.051149 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8ce9ee01-4b31-43a5-891f-d81ec65d17c8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:57.051568 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8ce9ee01-4b31-43a5-891f-d81ec65d17c8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:57.180271 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8ce9ee01-4b31-43a5-891f-d81ec65d17c8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:57.187922 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-8ce9ee01-4b31-43a5-891f-d81ec65d17c8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf" status: 200 len: 1367 microversion: 2.1 time: 0.150363 Aug 18 14:55:57.188499 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 394/656] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:57 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:58.208108 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-85f6ae9e-080b-442c-b571-abff3a3a2634 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:58.208730 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-85f6ae9e-080b-442c-b571-abff3a3a2634 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:58.215749 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-85f6ae9e-080b-442c-b571-abff3a3a2634 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:58.216238 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-85f6ae9e-080b-442c-b571-abff3a3a2634 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:58.216676 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-85f6ae9e-080b-442c-b571-abff3a3a2634 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:58.217370 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-85f6ae9e-080b-442c-b571-abff3a3a2634 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:58.217829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-85f6ae9e-080b-442c-b571-abff3a3a2634 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:58.218254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-85f6ae9e-080b-442c-b571-abff3a3a2634 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:58.349170 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-85f6ae9e-080b-442c-b571-abff3a3a2634 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:58.357361 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-85f6ae9e-080b-442c-b571-abff3a3a2634 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf" status: 200 len: 1367 microversion: 2.1 time: 0.153248 Aug 18 14:55:58.357928 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 395/657] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:58 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:59.378786 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b1da3484-1a25-48bf-b653-7264635f01e5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:55:59.379546 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b1da3484-1a25-48bf-b653-7264635f01e5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:55:59.381651 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=2 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:55:59.382343 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=12 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:55:59.390538 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b1da3484-1a25-48bf-b653-7264635f01e5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:59.391040 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b1da3484-1a25-48bf-b653-7264635f01e5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:59.391536 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b1da3484-1a25-48bf-b653-7264635f01e5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:59.392209 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b1da3484-1a25-48bf-b653-7264635f01e5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:59.392665 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b1da3484-1a25-48bf-b653-7264635f01e5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:59.393188 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b1da3484-1a25-48bf-b653-7264635f01e5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:59.541242 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b1da3484-1a25-48bf-b653-7264635f01e5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:55:59.549201 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b1da3484-1a25-48bf-b653-7264635f01e5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf" status: 200 len: 1367 microversion: 2.1 time: 0.174211 Aug 18 14:55:59.549809 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 396/658] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:55:59 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:55:59.558307 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-0ed8dcf3-7429-4164-b3a3-622e9f5fa38a req-1da24f1b-1450-48dd-bf28-ff967080c1c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0423b68b-575f-459e-a227-32d920e325cf", "name": "network-vif-plugged", "status": "completed", "tag": "233ce2fc-4700-4dcf-9eae-52ea3d8932d3"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:55:59.568004 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-0ed8dcf3-7429-4164-b3a3-622e9f5fa38a req-1da24f1b-1450-48dd-bf28-ff967080c1c2 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:55:59.569607 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-0ed8dcf3-7429-4164-b3a3-622e9f5fa38a req-1da24f1b-1450-48dd-bf28-ff967080c1c2 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:55:59.569607 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-0ed8dcf3-7429-4164-b3a3-622e9f5fa38a req-1da24f1b-1450-48dd-bf28-ff967080c1c2 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:55:59.581086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-0ed8dcf3-7429-4164-b3a3-622e9f5fa38a req-1da24f1b-1450-48dd-bf28-ff967080c1c2 service nova] Creating event network-vif-plugged:233ce2fc-4700-4dcf-9eae-52ea3d8932d3 for instance 0423b68b-575f-459e-a227-32d920e325cf on hv-cinder-85220 Aug 18 14:55:59.588224 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-0ed8dcf3-7429-4164-b3a3-622e9f5fa38a req-1da24f1b-1450-48dd-bf28-ff967080c1c2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033389 Aug 18 14:55:59.588809 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 397/659] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:56:00.573519 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-bc1ba626-14ab-4eb0-b5ab-1e6ff5042aa5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:00.574222 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-bc1ba626-14ab-4eb0-b5ab-1e6ff5042aa5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:00.580492 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bc1ba626-14ab-4eb0-b5ab-1e6ff5042aa5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:00.580973 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bc1ba626-14ab-4eb0-b5ab-1e6ff5042aa5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:00.581402 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bc1ba626-14ab-4eb0-b5ab-1e6ff5042aa5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:00.582113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bc1ba626-14ab-4eb0-b5ab-1e6ff5042aa5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:00.582565 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bc1ba626-14ab-4eb0-b5ab-1e6ff5042aa5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:00.583036 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bc1ba626-14ab-4eb0-b5ab-1e6ff5042aa5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:00.585989 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:56:00.714003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-bc1ba626-14ab-4eb0-b5ab-1e6ff5042aa5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:00.721637 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-bc1ba626-14ab-4eb0-b5ab-1e6ff5042aa5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf" status: 200 len: 1367 microversion: 2.1 time: 0.152817 Aug 18 14:56:00.722213 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 398/660] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:00 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:56:01.000725 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2723440c-e385-40a9-a4fd-02f99e723fdb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:01.001350 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2723440c-e385-40a9-a4fd-02f99e723fdb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:01.007839 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2723440c-e385-40a9-a4fd-02f99e723fdb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:01.008316 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2723440c-e385-40a9-a4fd-02f99e723fdb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:01.008745 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2723440c-e385-40a9-a4fd-02f99e723fdb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:01.009424 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2723440c-e385-40a9-a4fd-02f99e723fdb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:01.009872 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2723440c-e385-40a9-a4fd-02f99e723fdb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:01.010286 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2723440c-e385-40a9-a4fd-02f99e723fdb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:01.139563 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2723440c-e385-40a9-a4fd-02f99e723fdb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:01.148401 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2723440c-e385-40a9-a4fd-02f99e723fdb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:01.149948 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2723440c-e385-40a9-a4fd-02f99e723fdb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:01.151054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2723440c-e385-40a9-a4fd-02f99e723fdb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1795 microversion: 2.20 time: 0.154685 Aug 18 14:56:01.151846 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 399/661] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:56:00 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1795 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:56:01.743206 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-99c19e10-79cf-4a26-ab17-da29e8fa5be9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:01.743859 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-99c19e10-79cf-4a26-ab17-da29e8fa5be9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:01.750192 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-99c19e10-79cf-4a26-ab17-da29e8fa5be9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:01.750667 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-99c19e10-79cf-4a26-ab17-da29e8fa5be9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:01.751093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-99c19e10-79cf-4a26-ab17-da29e8fa5be9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:01.751801 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-99c19e10-79cf-4a26-ab17-da29e8fa5be9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:01.752248 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-99c19e10-79cf-4a26-ab17-da29e8fa5be9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:01.752664 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-99c19e10-79cf-4a26-ab17-da29e8fa5be9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:01.886836 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-99c19e10-79cf-4a26-ab17-da29e8fa5be9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:01.894478 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-99c19e10-79cf-4a26-ab17-da29e8fa5be9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf" status: 200 len: 1367 microversion: 2.1 time: 0.155558 Aug 18 14:56:01.895038 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 400/662] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:01 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:56:02.919080 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-51e0a83a-f9db-4fec-b7b9-cd9ae250e62b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:02.919641 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-51e0a83a-f9db-4fec-b7b9-cd9ae250e62b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:02.926166 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-51e0a83a-f9db-4fec-b7b9-cd9ae250e62b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:02.926659 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-51e0a83a-f9db-4fec-b7b9-cd9ae250e62b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:02.927097 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-51e0a83a-f9db-4fec-b7b9-cd9ae250e62b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:02.928397 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-51e0a83a-f9db-4fec-b7b9-cd9ae250e62b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:02.928850 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-51e0a83a-f9db-4fec-b7b9-cd9ae250e62b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:02.929274 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-51e0a83a-f9db-4fec-b7b9-cd9ae250e62b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:03.060368 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-51e0a83a-f9db-4fec-b7b9-cd9ae250e62b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:03.067919 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-51e0a83a-f9db-4fec-b7b9-cd9ae250e62b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf" status: 200 len: 1367 microversion: 2.1 time: 0.152847 Aug 18 14:56:03.068985 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 401/663] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:02 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:56:04.089317 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-609b0059-0869-4091-a79f-a46ca2d7cebe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:04.089955 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-609b0059-0869-4091-a79f-a46ca2d7cebe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:04.096300 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-609b0059-0869-4091-a79f-a46ca2d7cebe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:04.096786 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-609b0059-0869-4091-a79f-a46ca2d7cebe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:04.097221 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-609b0059-0869-4091-a79f-a46ca2d7cebe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:04.097912 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-609b0059-0869-4091-a79f-a46ca2d7cebe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:04.098457 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-609b0059-0869-4091-a79f-a46ca2d7cebe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:04.098834 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-609b0059-0869-4091-a79f-a46ca2d7cebe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:04.232229 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-609b0059-0869-4091-a79f-a46ca2d7cebe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:04.239902 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-609b0059-0869-4091-a79f-a46ca2d7cebe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf" status: 200 len: 1367 microversion: 2.1 time: 0.154545 Aug 18 14:56:04.240534 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 402/664] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:04 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:56:05.259997 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-edda6ec8-3364-4e4d-ba3c-eecffcb97fbe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:05.261006 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-edda6ec8-3364-4e4d-ba3c-eecffcb97fbe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:05.267270 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-edda6ec8-3364-4e4d-ba3c-eecffcb97fbe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:05.267779 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-edda6ec8-3364-4e4d-ba3c-eecffcb97fbe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:05.268207 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-edda6ec8-3364-4e4d-ba3c-eecffcb97fbe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:05.268889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-edda6ec8-3364-4e4d-ba3c-eecffcb97fbe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:05.269338 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-edda6ec8-3364-4e4d-ba3c-eecffcb97fbe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:05.269759 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-edda6ec8-3364-4e4d-ba3c-eecffcb97fbe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:05.398271 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-edda6ec8-3364-4e4d-ba3c-eecffcb97fbe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:05.406433 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-edda6ec8-3364-4e4d-ba3c-eecffcb97fbe tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf" status: 200 len: 1557 microversion: 2.1 time: 0.150246 Aug 18 14:56:05.406995 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 403/665] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:05 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:56:05.425843 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-025e4c77-0624-4cf2-adc0-2c03f4048f73 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:05.426335 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-025e4c77-0624-4cf2-adc0-2c03f4048f73 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:05.432456 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-025e4c77-0624-4cf2-adc0-2c03f4048f73 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:05.432935 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-025e4c77-0624-4cf2-adc0-2c03f4048f73 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:05.433366 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-025e4c77-0624-4cf2-adc0-2c03f4048f73 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:05.434055 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-025e4c77-0624-4cf2-adc0-2c03f4048f73 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:05.434504 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-025e4c77-0624-4cf2-adc0-2c03f4048f73 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:05.434922 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-025e4c77-0624-4cf2-adc0-2c03f4048f73 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:05.511556 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-025e4c77-0624-4cf2-adc0-2c03f4048f73 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089127 Aug 18 14:56:05.512117 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 404/666] 10.222.0.36 () {58 vars in 1275 bytes} [Thu Aug 18 14:56:05 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:56:06.659364 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-4469e9b1-47e1-48bf-b142-811355ce2bc8 req-1a9b139c-3f65-4c38-99ea-d3fb755bab43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0423b68b-575f-459e-a227-32d920e325cf", "tag": "233ce2fc-4700-4dcf-9eae-52ea3d8932d3"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:56:06.669565 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-4469e9b1-47e1-48bf-b142-811355ce2bc8 req-1a9b139c-3f65-4c38-99ea-d3fb755bab43 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:06.670035 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-4469e9b1-47e1-48bf-b142-811355ce2bc8 req-1a9b139c-3f65-4c38-99ea-d3fb755bab43 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:06.670459 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-4469e9b1-47e1-48bf-b142-811355ce2bc8 req-1a9b139c-3f65-4c38-99ea-d3fb755bab43 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:06.681622 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-4469e9b1-47e1-48bf-b142-811355ce2bc8 req-1a9b139c-3f65-4c38-99ea-d3fb755bab43 service nova] Creating event network-changed:233ce2fc-4700-4dcf-9eae-52ea3d8932d3 for instance 0423b68b-575f-459e-a227-32d920e325cf on hv-cinder-85220 Aug 18 14:56:06.687534 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-4469e9b1-47e1-48bf-b142-811355ce2bc8 req-1a9b139c-3f65-4c38-99ea-d3fb755bab43 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031740 Aug 18 14:56:06.688276 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 405/667] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:56:07.029490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c6192f26-9bbf-42fa-b390-65ac68cfbe8d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:07.030301 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c6192f26-9bbf-42fa-b390-65ac68cfbe8d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: 359bcf74-3804-413e-9c13-4fcd166074c1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:07.037368 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c6192f26-9bbf-42fa-b390-65ac68cfbe8d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:07.037929 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c6192f26-9bbf-42fa-b390-65ac68cfbe8d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:07.038628 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c6192f26-9bbf-42fa-b390-65ac68cfbe8d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:07.039755 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c6192f26-9bbf-42fa-b390-65ac68cfbe8d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:07.040533 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c6192f26-9bbf-42fa-b390-65ac68cfbe8d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:07.041178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c6192f26-9bbf-42fa-b390-65ac68cfbe8d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:07.125905 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.objects.instance [None req-c6192f26-9bbf-42fa-b390-65ac68cfbe8d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lazy-loading 'services' on Instance uuid 359bcf74-3804-413e-9c13-4fcd166074c1 {{(pid=132268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:56:07.207964 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c6192f26-9bbf-42fa-b390-65ac68cfbe8d tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "DELETE /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1/os-volume_attachments/feecdb0d-b490-489d-9a8d-405361bafc77" status: 202 len: 0 microversion: 2.1 time: 0.182616 Aug 18 14:56:07.209682 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 406/668] 10.222.0.36 () {58 vars in 1416 bytes} [Thu Aug 18 14:56:07 2022] DELETE /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1/os-volume_attachments/feecdb0d-b490-489d-9a8d-405361bafc77 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 14:56:09.390909 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-30826ee7-09a5-48a9-8d53-bd3b38a8177e tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:09.391564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-30826ee7-09a5-48a9-8d53-bd3b38a8177e tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: 359bcf74-3804-413e-9c13-4fcd166074c1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:09.398837 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-30826ee7-09a5-48a9-8d53-bd3b38a8177e tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:09.399325 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-30826ee7-09a5-48a9-8d53-bd3b38a8177e tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:09.399783 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-30826ee7-09a5-48a9-8d53-bd3b38a8177e tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:09.400477 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-30826ee7-09a5-48a9-8d53-bd3b38a8177e tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:09.400930 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-30826ee7-09a5-48a9-8d53-bd3b38a8177e tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:09.401350 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-30826ee7-09a5-48a9-8d53-bd3b38a8177e tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:09.426338 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-30826ee7-09a5-48a9-8d53-bd3b38a8177e tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: 359bcf74-3804-413e-9c13-4fcd166074c1] Going to try to terminate instance {{(pid=132268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:56:09.502514 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-30826ee7-09a5-48a9-8d53-bd3b38a8177e tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "DELETE /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1" status: 204 len: 0 microversion: 2.1 time: 0.115473 Aug 18 14:56:09.503082 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 407/669] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 14:56:09 2022] DELETE /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 14:56:09.514347 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b86fb0e5-2015-4b68-a6d5-6cd9e9709c08 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:09.515167 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b86fb0e5-2015-4b68-a6d5-6cd9e9709c08 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: 359bcf74-3804-413e-9c13-4fcd166074c1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:09.522023 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b86fb0e5-2015-4b68-a6d5-6cd9e9709c08 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:09.522504 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b86fb0e5-2015-4b68-a6d5-6cd9e9709c08 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:09.522960 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b86fb0e5-2015-4b68-a6d5-6cd9e9709c08 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:09.523643 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b86fb0e5-2015-4b68-a6d5-6cd9e9709c08 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:09.524142 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b86fb0e5-2015-4b68-a6d5-6cd9e9709c08 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:09.524559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b86fb0e5-2015-4b68-a6d5-6cd9e9709c08 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:09.658277 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b86fb0e5-2015-4b68-a6d5-6cd9e9709c08 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:09.666173 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b86fb0e5-2015-4b68-a6d5-6cd9e9709c08 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1" status: 200 len: 1514 microversion: 2.1 time: 0.157956 Aug 18 14:56:09.666731 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 408/670] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:09 2022] GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:56:10.687055 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-fc48ee2a-6f2d-4a0f-916d-765b1e1041f6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:10.687748 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-fc48ee2a-6f2d-4a0f-916d-765b1e1041f6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: 359bcf74-3804-413e-9c13-4fcd166074c1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:10.694899 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fc48ee2a-6f2d-4a0f-916d-765b1e1041f6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:10.695371 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fc48ee2a-6f2d-4a0f-916d-765b1e1041f6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:10.695827 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fc48ee2a-6f2d-4a0f-916d-765b1e1041f6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:10.696508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fc48ee2a-6f2d-4a0f-916d-765b1e1041f6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:10.696957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fc48ee2a-6f2d-4a0f-916d-765b1e1041f6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:10.697372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fc48ee2a-6f2d-4a0f-916d-765b1e1041f6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:10.825277 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-fc48ee2a-6f2d-4a0f-916d-765b1e1041f6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:10.832859 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-fc48ee2a-6f2d-4a0f-916d-765b1e1041f6 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1" status: 200 len: 1514 microversion: 2.1 time: 0.149697 Aug 18 14:56:10.833420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 409/671] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:10 2022] GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:56:11.853754 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c0ff02b3-d260-49bc-a36b-85c8052c1425 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:11.854375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c0ff02b3-d260-49bc-a36b-85c8052c1425 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: 359bcf74-3804-413e-9c13-4fcd166074c1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:11.860746 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c0ff02b3-d260-49bc-a36b-85c8052c1425 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:11.861229 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c0ff02b3-d260-49bc-a36b-85c8052c1425 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:11.861661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c0ff02b3-d260-49bc-a36b-85c8052c1425 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:11.862354 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c0ff02b3-d260-49bc-a36b-85c8052c1425 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:11.862807 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c0ff02b3-d260-49bc-a36b-85c8052c1425 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:11.863228 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c0ff02b3-d260-49bc-a36b-85c8052c1425 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:12.104341 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c0ff02b3-d260-49bc-a36b-85c8052c1425 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca1c6464b6d432ab1bd3898c69a3e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5f78066ec41e98faa23bacd4881cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:12.112075 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c0ff02b3-d260-49bc-a36b-85c8052c1425 tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1" status: 200 len: 1514 microversion: 2.1 time: 0.262390 Aug 18 14:56:12.112643 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 410/672] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:11 2022] GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1 => generated 1514 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:56:12.117121 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-f7c82907-e4f0-4107-98d9-4ef9867cae61 req-044c98ca-7bd2-43b0-a315-ab93ca857d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "359bcf74-3804-413e-9c13-4fcd166074c1", "name": "network-vif-deleted", "tag": "3205617c-7d60-4edf-b381-92f27aad338e"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:56:12.128950 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-f7c82907-e4f0-4107-98d9-4ef9867cae61 req-044c98ca-7bd2-43b0-a315-ab93ca857d11 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:12.129417 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-f7c82907-e4f0-4107-98d9-4ef9867cae61 req-044c98ca-7bd2-43b0-a315-ab93ca857d11 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:12.129844 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-f7c82907-e4f0-4107-98d9-4ef9867cae61 req-044c98ca-7bd2-43b0-a315-ab93ca857d11 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:12.142605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-f7c82907-e4f0-4107-98d9-4ef9867cae61 req-044c98ca-7bd2-43b0-a315-ab93ca857d11 service nova] Creating event network-vif-deleted:3205617c-7d60-4edf-b381-92f27aad338e for instance 359bcf74-3804-413e-9c13-4fcd166074c1 on hv-cinder-85220 Aug 18 14:56:12.148301 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-f7c82907-e4f0-4107-98d9-4ef9867cae61 req-044c98ca-7bd2-43b0-a315-ab93ca857d11 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034570 Aug 18 14:56:12.148882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 411/673] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:56:13.135364 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-641c5d91-8f06-480d-b7b0-f6220df4b2ac tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:13.136367 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-641c5d91-8f06-480d-b7b0-f6220df4b2ac tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] [instance: 359bcf74-3804-413e-9c13-4fcd166074c1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:13.143043 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-641c5d91-8f06-480d-b7b0-f6220df4b2ac tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:13.143525 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-641c5d91-8f06-480d-b7b0-f6220df4b2ac tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:13.143996 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-641c5d91-8f06-480d-b7b0-f6220df4b2ac tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:13.144687 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-641c5d91-8f06-480d-b7b0-f6220df4b2ac tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:13.145142 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-641c5d91-8f06-480d-b7b0-f6220df4b2ac tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:13.145565 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-641c5d91-8f06-480d-b7b0-f6220df4b2ac tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:13.158795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-641c5d91-8f06-480d-b7b0-f6220df4b2ac tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] HTTP exception thrown: Instance 359bcf74-3804-413e-9c13-4fcd166074c1 could not be found. Aug 18 14:56:13.160508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-641c5d91-8f06-480d-b7b0-f6220df4b2ac tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Request method failure captured: Aug 18 14:56:13.160508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1 HTTP/1.1 Aug 18 14:56:13.160508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:56:13.160508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:56:13.160508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:56:13.160508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:56:13.160508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:56:13.160508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:56:13.160508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:56:13.160508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:56:13.160508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lJm9sfE03D49GL6sZ71zK6HbcP7pWXFwNZ9TQ2CzlQRQ032pFnURL-H3Wi-VaNR-wft4CPMau6L9Oyyaalcv_gVOj6kaKQ0Yo5p7g6-wDUzTVWdBle6ea_e5kPXCtKqYRmHovd_ewIA61c5ltkItj6qurhkC2oPlzOLLzyvQpDgeVQ Aug 18 14:56:13.160508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:56:13.160508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:56:13.160508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:56:13.160508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:56:13.160508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:56:13.160508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:56:13.160508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: 49b5f78066ec41e98faa23bacd4881cf Aug 18 14:56:13.160508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-VolumesSnapshotTestJSON-549953966 Aug 18 14:56:13.160508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:56:13.160508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:56:13.162186 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/49b5f78066ec41e98faa23bacd4881cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/49b5f78066ec41e98faa23bacd4881cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_49b5f78066ec41e98faa23bacd4881cf", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/49b5f78066ec41e98faa23bacd4881cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:56:13.162186 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-VolumesSnapshotTestJSON-549953966 Aug 18 14:56:13.162186 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: 49b5f78066ec41e98faa23bacd4881cf Aug 18 14:56:13.162186 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-549953966 Aug 18 14:56:13.162186 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-VolumesSnapshotTestJSON-549953966-project Aug 18 14:56:13.162186 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:56:13.162186 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:56:13.162186 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 2ca1c6464b6d432ab1bd3898c69a3e47 Aug 18 14:56:13.162186 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-VolumesSnapshotTestJSON-549953966-project Aug 18 14:56:13.162186 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:56:13.162186 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 359bcf74-3804-413e-9c13-4fcd166074c1 could not be found. Aug 18 14:56:13.162186 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '359bcf74-3804-413e-9c13-4fcd166074c1'} Aug 18 14:56:13.163420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:56:13.163420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:56:13.163420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:56:13.163420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:56:13.163420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:56:13.163420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:56:13.163420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:56:13.163420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:56:13.163420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:56:13.163420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:56:13.163420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 359bcf74-3804-413e-9c13-4fcd166074c1 could not be found. Aug 18 14:56:13.163420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:56:13.163420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:56:13.163420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:56:13.163420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:56:13.163420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:56:13.163420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:56:13.163420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:56:13.163420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:56:13.163420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:56:13.165026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:56:13.165026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:56:13.165026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:56:13.165026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:56:13.165026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:56:13.165026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:56:13.165026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:56:13.165026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 359bcf74-3804-413e-9c13-4fcd166074c1 could not be found. Aug 18 14:56:13.165026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:56:13.165026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:56:13.165026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:56:13.165026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:56:13.165026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:56:13.165026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:56:13.165026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:56:13.165026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:56:13.165026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 359bcf74-3804-413e-9c13-4fcd166074c1 could not be found. Aug 18 14:56:13.165026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:56:13.166647 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-641c5d91-8f06-480d-b7b0-f6220df4b2ac tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] Returning 404 to user: Instance 359bcf74-3804-413e-9c13-4fcd166074c1 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:56:13.166647 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-641c5d91-8f06-480d-b7b0-f6220df4b2ac tempest-VolumesSnapshotTestJSON-549953966 tempest-VolumesSnapshotTestJSON-549953966-project] 10.222.0.36 "GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1" status: 404 len: 111 microversion: 2.1 time: 0.031317 Aug 18 14:56:13.166647 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 412/674] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:13 2022] GET /compute/v2.1/servers/359bcf74-3804-413e-9c13-4fcd166074c1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:56:20.294657 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b12a708b-6dbb-4892-92db-56eb948751cd tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:20.295299 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b12a708b-6dbb-4892-92db-56eb948751cd tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:20.297875 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=90,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:56:20.304268 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b12a708b-6dbb-4892-92db-56eb948751cd tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:20.304816 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b12a708b-6dbb-4892-92db-56eb948751cd tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:20.305254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b12a708b-6dbb-4892-92db-56eb948751cd tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:20.305945 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b12a708b-6dbb-4892-92db-56eb948751cd tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:20.306403 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b12a708b-6dbb-4892-92db-56eb948751cd tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:20.306888 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b12a708b-6dbb-4892-92db-56eb948751cd tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:20.336761 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b12a708b-6dbb-4892-92db-56eb948751cd tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9/os-volume_attachments/db06abe4-7e23-4d75-ace2-c9ea021dfebc" status: 200 len: 194 microversion: 2.20 time: 0.046249 Aug 18 14:56:20.337363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 413/675] 10.222.0.36 () {60 vars in 1454 bytes} [Thu Aug 18 14:56:20 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9/os-volume_attachments/db06abe4-7e23-4d75-ace2-c9ea021dfebc => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 14:56:20.403289 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-636f427c-72bb-4c51-bbb2-53894a2daa8f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:20.403824 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-636f427c-72bb-4c51-bbb2-53894a2daa8f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:20.409796 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-636f427c-72bb-4c51-bbb2-53894a2daa8f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:20.410247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-636f427c-72bb-4c51-bbb2-53894a2daa8f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:20.410692 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-636f427c-72bb-4c51-bbb2-53894a2daa8f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:20.411345 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-636f427c-72bb-4c51-bbb2-53894a2daa8f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:20.412436 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-636f427c-72bb-4c51-bbb2-53894a2daa8f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:20.412833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-636f427c-72bb-4c51-bbb2-53894a2daa8f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:20.661141 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:56:20.667847 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.objects.instance [None req-636f427c-72bb-4c51-bbb2-53894a2daa8f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lazy-loading 'services' on Instance uuid 3d2b6fc4-0338-4141-9ac3-7b579718fae9 {{(pid=132268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:56:20.741485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-636f427c-72bb-4c51-bbb2-53894a2daa8f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9/os-volume_attachments/db06abe4-7e23-4d75-ace2-c9ea021dfebc" status: 202 len: 0 microversion: 2.20 time: 0.341943 Aug 18 14:56:20.742085 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 414/676] 10.222.0.36 () {60 vars in 1457 bytes} [Thu Aug 18 14:56:20 2022] DELETE /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9/os-volume_attachments/db06abe4-7e23-4d75-ace2-c9ea021dfebc => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 18 14:56:20.751239 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ed4823bc-f288-431d-8d0c-006545b3ac1f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:20.753649 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ed4823bc-f288-431d-8d0c-006545b3ac1f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:20.761185 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ed4823bc-f288-431d-8d0c-006545b3ac1f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:20.761819 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ed4823bc-f288-431d-8d0c-006545b3ac1f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:20.762258 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ed4823bc-f288-431d-8d0c-006545b3ac1f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:20.762977 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ed4823bc-f288-431d-8d0c-006545b3ac1f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:20.763434 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ed4823bc-f288-431d-8d0c-006545b3ac1f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:20.763892 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ed4823bc-f288-431d-8d0c-006545b3ac1f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:20.795884 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-ed4823bc-f288-431d-8d0c-006545b3ac1f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048957 Aug 18 14:56:20.796638 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 415/677] 10.222.0.36 () {60 vars in 1343 bytes} [Thu Aug 18 14:56:20 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 14:56:21.809365 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-dc1f70d2-b0f5-47eb-a134-de2966710ff6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:21.811403 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-dc1f70d2-b0f5-47eb-a134-de2966710ff6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:21.817757 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dc1f70d2-b0f5-47eb-a134-de2966710ff6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:21.818229 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dc1f70d2-b0f5-47eb-a134-de2966710ff6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:21.818656 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dc1f70d2-b0f5-47eb-a134-de2966710ff6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:21.819330 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dc1f70d2-b0f5-47eb-a134-de2966710ff6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:21.819814 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dc1f70d2-b0f5-47eb-a134-de2966710ff6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:21.820236 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dc1f70d2-b0f5-47eb-a134-de2966710ff6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:21.848653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-dc1f70d2-b0f5-47eb-a134-de2966710ff6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043386 Aug 18 14:56:21.849812 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 416/678] 10.222.0.36 () {60 vars in 1343 bytes} [Thu Aug 18 14:56:21 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 14:56:22.861204 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e7fc1faa-e1b0-48d9-8530-af61eedef956 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:22.863446 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e7fc1faa-e1b0-48d9-8530-af61eedef956 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:22.869916 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e7fc1faa-e1b0-48d9-8530-af61eedef956 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:22.870398 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e7fc1faa-e1b0-48d9-8530-af61eedef956 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:22.870832 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e7fc1faa-e1b0-48d9-8530-af61eedef956 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:22.871522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e7fc1faa-e1b0-48d9-8530-af61eedef956 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:22.872103 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e7fc1faa-e1b0-48d9-8530-af61eedef956 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:22.872528 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e7fc1faa-e1b0-48d9-8530-af61eedef956 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:22.902672 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e7fc1faa-e1b0-48d9-8530-af61eedef956 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045580 Aug 18 14:56:22.903239 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 417/679] 10.222.0.36 () {60 vars in 1343 bytes} [Thu Aug 18 14:56:22 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:56:22.966585 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0d7ee248-4f73-438c-88db-f1a380bd709a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:22.967079 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0d7ee248-4f73-438c-88db-f1a380bd709a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:22.973040 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0d7ee248-4f73-438c-88db-f1a380bd709a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:22.973511 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0d7ee248-4f73-438c-88db-f1a380bd709a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:22.973938 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0d7ee248-4f73-438c-88db-f1a380bd709a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:22.974699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0d7ee248-4f73-438c-88db-f1a380bd709a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:22.975146 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0d7ee248-4f73-438c-88db-f1a380bd709a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:22.975564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0d7ee248-4f73-438c-88db-f1a380bd709a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:23.000724 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0d7ee248-4f73-438c-88db-f1a380bd709a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Going to try to terminate instance {{(pid=132268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:56:23.078302 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0d7ee248-4f73-438c-88db-f1a380bd709a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 204 len: 0 microversion: 2.20 time: 0.115183 Aug 18 14:56:23.078972 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 418/680] 10.222.0.36 () {60 vars in 1280 bytes} [Thu Aug 18 14:56:22 2022] DELETE /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 18 14:56:23.088197 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-6b7e28a3-e15c-4486-bc87-f567b36d4e7f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:23.088886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-6b7e28a3-e15c-4486-bc87-f567b36d4e7f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:23.094677 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6b7e28a3-e15c-4486-bc87-f567b36d4e7f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:23.095160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6b7e28a3-e15c-4486-bc87-f567b36d4e7f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:23.095600 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6b7e28a3-e15c-4486-bc87-f567b36d4e7f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:23.096313 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6b7e28a3-e15c-4486-bc87-f567b36d4e7f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:23.096764 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6b7e28a3-e15c-4486-bc87-f567b36d4e7f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:23.097185 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6b7e28a3-e15c-4486-bc87-f567b36d4e7f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:23.230883 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6b7e28a3-e15c-4486-bc87-f567b36d4e7f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:23.239124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6b7e28a3-e15c-4486-bc87-f567b36d4e7f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:23.241280 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6b7e28a3-e15c-4486-bc87-f567b36d4e7f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:23.242434 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-6b7e28a3-e15c-4486-bc87-f567b36d4e7f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.158509 Aug 18 14:56:23.243179 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 419/681] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:56:23 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:56:24.265496 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ad408490-1b25-45d9-98fd-3d15e1995837 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:24.266135 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ad408490-1b25-45d9-98fd-3d15e1995837 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:24.273216 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ad408490-1b25-45d9-98fd-3d15e1995837 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:24.273697 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ad408490-1b25-45d9-98fd-3d15e1995837 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:24.274128 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ad408490-1b25-45d9-98fd-3d15e1995837 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:24.274812 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ad408490-1b25-45d9-98fd-3d15e1995837 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:24.275267 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ad408490-1b25-45d9-98fd-3d15e1995837 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:24.275729 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ad408490-1b25-45d9-98fd-3d15e1995837 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:24.402748 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ad408490-1b25-45d9-98fd-3d15e1995837 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:24.410807 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ad408490-1b25-45d9-98fd-3d15e1995837 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:24.412886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ad408490-1b25-45d9-98fd-3d15e1995837 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:24.414036 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-ad408490-1b25-45d9-98fd-3d15e1995837 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.152451 Aug 18 14:56:24.414582 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 420/682] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:56:24 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:56:25.436901 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f5059ae3-e973-4c60-8ad8-3f9f8908b50b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:25.437574 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f5059ae3-e973-4c60-8ad8-3f9f8908b50b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:25.444582 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f5059ae3-e973-4c60-8ad8-3f9f8908b50b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:25.445069 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f5059ae3-e973-4c60-8ad8-3f9f8908b50b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:25.445505 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f5059ae3-e973-4c60-8ad8-3f9f8908b50b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:25.446199 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f5059ae3-e973-4c60-8ad8-3f9f8908b50b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:25.446654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f5059ae3-e973-4c60-8ad8-3f9f8908b50b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:25.447080 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f5059ae3-e973-4c60-8ad8-3f9f8908b50b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:25.576643 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f5059ae3-e973-4c60-8ad8-3f9f8908b50b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:25.585526 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f5059ae3-e973-4c60-8ad8-3f9f8908b50b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:25.587030 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f5059ae3-e973-4c60-8ad8-3f9f8908b50b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:25.588234 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f5059ae3-e973-4c60-8ad8-3f9f8908b50b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.155269 Aug 18 14:56:25.588792 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 421/683] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:56:25 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:56:26.610998 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a8ea4ac3-7193-41d8-8378-a29b089cf12e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:26.611643 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a8ea4ac3-7193-41d8-8378-a29b089cf12e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:26.617891 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a8ea4ac3-7193-41d8-8378-a29b089cf12e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:26.618379 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a8ea4ac3-7193-41d8-8378-a29b089cf12e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:26.618817 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a8ea4ac3-7193-41d8-8378-a29b089cf12e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:26.619508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a8ea4ac3-7193-41d8-8378-a29b089cf12e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:26.619997 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a8ea4ac3-7193-41d8-8378-a29b089cf12e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:26.620426 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a8ea4ac3-7193-41d8-8378-a29b089cf12e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:26.759099 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a8ea4ac3-7193-41d8-8378-a29b089cf12e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:26.767788 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a8ea4ac3-7193-41d8-8378-a29b089cf12e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:26.769296 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a8ea4ac3-7193-41d8-8378-a29b089cf12e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:26.770475 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a8ea4ac3-7193-41d8-8378-a29b089cf12e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.163454 Aug 18 14:56:26.771577 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 422/684] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:56:26 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:56:27.794156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-4458f067-da62-455c-91bd-ae66390ca1c6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:27.794802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-4458f067-da62-455c-91bd-ae66390ca1c6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:27.801620 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4458f067-da62-455c-91bd-ae66390ca1c6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:27.802270 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4458f067-da62-455c-91bd-ae66390ca1c6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:27.802723 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4458f067-da62-455c-91bd-ae66390ca1c6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:27.803472 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4458f067-da62-455c-91bd-ae66390ca1c6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:27.803999 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4458f067-da62-455c-91bd-ae66390ca1c6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:27.804561 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4458f067-da62-455c-91bd-ae66390ca1c6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:28.022326 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-4458f067-da62-455c-91bd-ae66390ca1c6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:28.030752 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-4458f067-da62-455c-91bd-ae66390ca1c6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:28.032447 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-4458f067-da62-455c-91bd-ae66390ca1c6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:28.033837 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-4458f067-da62-455c-91bd-ae66390ca1c6 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1723 microversion: 2.20 time: 0.243546 Aug 18 14:56:28.034471 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 423/685] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:56:27 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:56:28.737024 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-df70b24c-1830-4dbb-b595-2120ff0c36b9 req-f4f66b2a-3b49-4033-acf3-e13ff605c7be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2b6fc4-0338-4141-9ac3-7b579718fae9", "name": "network-vif-deleted", "tag": "54c7f937-7b5c-43bd-9d41-2e0484619d5f"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:56:28.748419 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-df70b24c-1830-4dbb-b595-2120ff0c36b9 req-f4f66b2a-3b49-4033-acf3-e13ff605c7be service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:28.748906 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-df70b24c-1830-4dbb-b595-2120ff0c36b9 req-f4f66b2a-3b49-4033-acf3-e13ff605c7be service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:28.749400 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-df70b24c-1830-4dbb-b595-2120ff0c36b9 req-f4f66b2a-3b49-4033-acf3-e13ff605c7be service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:28.767355 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-df70b24c-1830-4dbb-b595-2120ff0c36b9 req-f4f66b2a-3b49-4033-acf3-e13ff605c7be service nova] Creating event network-vif-deleted:54c7f937-7b5c-43bd-9d41-2e0484619d5f for instance 3d2b6fc4-0338-4141-9ac3-7b579718fae9 on hv-cinder-85220 Aug 18 14:56:28.773436 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-df70b24c-1830-4dbb-b595-2120ff0c36b9 req-f4f66b2a-3b49-4033-acf3-e13ff605c7be service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051383 Aug 18 14:56:28.773964 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 424/686] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:56:29.058273 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2dd8cf11-45d3-4970-b03f-1eb6c183ec9e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:29.058986 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2dd8cf11-45d3-4970-b03f-1eb6c183ec9e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:29.065683 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2dd8cf11-45d3-4970-b03f-1eb6c183ec9e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:29.066102 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2dd8cf11-45d3-4970-b03f-1eb6c183ec9e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:29.066538 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2dd8cf11-45d3-4970-b03f-1eb6c183ec9e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:29.067233 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2dd8cf11-45d3-4970-b03f-1eb6c183ec9e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:29.068193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2dd8cf11-45d3-4970-b03f-1eb6c183ec9e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:29.068633 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2dd8cf11-45d3-4970-b03f-1eb6c183ec9e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:29.101792 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2dd8cf11-45d3-4970-b03f-1eb6c183ec9e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:29.102273 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2dd8cf11-45d3-4970-b03f-1eb6c183ec9e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:29.102716 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2dd8cf11-45d3-4970-b03f-1eb6c183ec9e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:29.103166 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.objects.instance [None req-2dd8cf11-45d3-4970-b03f-1eb6c183ec9e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lazy-loading 'fault' on Instance uuid 3d2b6fc4-0338-4141-9ac3-7b579718fae9 {{(pid=132268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:56:29.145237 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2dd8cf11-45d3-4970-b03f-1eb6c183ec9e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:29.154108 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2dd8cf11-45d3-4970-b03f-1eb6c183ec9e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:29.155718 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2dd8cf11-45d3-4970-b03f-1eb6c183ec9e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:29.156889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2dd8cf11-45d3-4970-b03f-1eb6c183ec9e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 200 len: 1371 microversion: 2.20 time: 0.103011 Aug 18 14:56:29.157770 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 425/687] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:56:29 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:56:30.180277 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-4830ee69-8990-4ad9-a293-f71727b4bb8a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:30.181007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-4830ee69-8990-4ad9-a293-f71727b4bb8a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:30.187438 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4830ee69-8990-4ad9-a293-f71727b4bb8a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:30.187966 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4830ee69-8990-4ad9-a293-f71727b4bb8a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:30.188403 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4830ee69-8990-4ad9-a293-f71727b4bb8a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:30.189102 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4830ee69-8990-4ad9-a293-f71727b4bb8a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:30.189559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4830ee69-8990-4ad9-a293-f71727b4bb8a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:30.189995 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4830ee69-8990-4ad9-a293-f71727b4bb8a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:30.203988 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-4830ee69-8990-4ad9-a293-f71727b4bb8a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] HTTP exception thrown: Instance 3d2b6fc4-0338-4141-9ac3-7b579718fae9 could not be found. Aug 18 14:56:30.205648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-4830ee69-8990-4ad9-a293-f71727b4bb8a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Request method failure captured: Aug 18 14:56:30.205648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 HTTP/1.1 Aug 18 14:56:30.205648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:56:30.205648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:56:30.205648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:56:30.205648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:56:30.205648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:56:30.205648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:56:30.205648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:56:30.205648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:56:30.205648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lH7zwFk8WrSTq6G01PM-9lXg9vxcQiJ2OXlNoO1fAQLssQJV-ZtF70LsGcxCBcKb3x3HtoOGVR9BN0TQGYehGA18R5A7qbUo3jtyF51HoVtsQj6so1ZYXbs3LvwW_nbOeN96fl4KGf_ya0nqGdS1LevxLlzbdB2w-QN91VI4eRRfs8 Aug 18 14:56:30.205648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:56:30.205648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:56:30.205648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:56:30.205648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:56:30.205648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 14:56:30.205648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:56:30.205648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:56:30.205648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: 594f04dadf2a45fcb5fe2a80744cb9e6 Aug 18 14:56:30.205648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-18518996 Aug 18 14:56:30.205648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:56:30.205648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:56:30.207282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/594f04dadf2a45fcb5fe2a80744cb9e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/594f04dadf2a45fcb5fe2a80744cb9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_594f04dadf2a45fcb5fe2a80744cb9e6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/594f04dadf2a45fcb5fe2a80744cb9e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:56:30.207282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-AttachVolumeShelveTestJSON-18518996 Aug 18 14:56:30.207282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: 594f04dadf2a45fcb5fe2a80744cb9e6 Aug 18 14:56:30.207282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-18518996 Aug 18 14:56:30.207282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-AttachVolumeShelveTestJSON-18518996-project Aug 18 14:56:30.207282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:56:30.207282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:56:30.207282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 09b055bb15ce4b2ab4276b0090e16122 Aug 18 14:56:30.207282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-AttachVolumeShelveTestJSON-18518996-project Aug 18 14:56:30.207282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:56:30.207282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 3d2b6fc4-0338-4141-9ac3-7b579718fae9 could not be found. Aug 18 14:56:30.207282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '3d2b6fc4-0338-4141-9ac3-7b579718fae9'} Aug 18 14:56:30.208126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:56:30.208126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:56:30.208126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:56:30.208126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:56:30.208126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:56:30.208126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:56:30.208126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:56:30.208126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:56:30.208126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:56:30.208126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:56:30.208126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d2b6fc4-0338-4141-9ac3-7b579718fae9 could not be found. Aug 18 14:56:30.208126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:56:30.208126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:56:30.208126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:56:30.208126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:56:30.208126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:56:30.208126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:56:30.208126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:56:30.208126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:56:30.208126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:56:30.209392 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:56:30.209392 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:56:30.209392 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:56:30.209392 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:56:30.209392 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:56:30.209392 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:56:30.209392 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:56:30.209392 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d2b6fc4-0338-4141-9ac3-7b579718fae9 could not be found. Aug 18 14:56:30.209392 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:56:30.209392 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:56:30.209392 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:56:30.209392 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:56:30.209392 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:56:30.209392 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:56:30.209392 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:56:30.209392 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:56:30.209392 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d2b6fc4-0338-4141-9ac3-7b579718fae9 could not be found. Aug 18 14:56:30.209392 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:56:30.210680 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-4830ee69-8990-4ad9-a293-f71727b4bb8a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Returning 404 to user: Instance 3d2b6fc4-0338-4141-9ac3-7b579718fae9 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:56:30.210680 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-4830ee69-8990-4ad9-a293-f71727b4bb8a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 404 len: 111 microversion: 2.20 time: 0.031210 Aug 18 14:56:30.210680 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 426/688] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:56:30 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 18 14:56:30.215802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b92bc467-6684-4e46-8000-ba3eab71d7dc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '.version_select at 0x7fb21406fb80>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:30.234831 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b92bc467-6684-4e46-8000-ba3eab71d7dc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-169930311" status: 204 len: 0 microversion: 2.20 time: 0.022558 Aug 18 14:56:30.235393 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 427/689] 10.222.0.36 () {60 vars in 1259 bytes} [Thu Aug 18 14:56:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-169930311 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 18 14:56:30.870698 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-55cf8d51-b620-4e41-a5c7-9c998e4c7e83 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Action: 'create', calling method: .version_select at 0x7fb2142c00d0>, body: {"keypair": {"name": "tempest-keypair-860120649", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHERLWdebX4S/iOOjSvaYmZJjveIK2azcqFGgIThu2UH2ppMYNQrhZkC5OhimbqCXr3PqRvi47HmZ16BI/ILNuphrKzcLv78BdLOMEkbyAn3NMrgZvUTPXCpQ6UE6Cayg=="}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:56:30.887794 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-55cf8d51-b620-4e41-a5c7-9c998e4c7e83 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Getting quotas for project 594f04dadf2a45fcb5fe2a80744cb9e6. Resources: {'key_pairs'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:56:30.892172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-55cf8d51-b620-4e41-a5c7-9c998e4c7e83 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Getting quotas for user 09b055bb15ce4b2ab4276b0090e16122 and project 594f04dadf2a45fcb5fe2a80744cb9e6. Resources: {'key_pairs'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:56:30.918910 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-55cf8d51-b620-4e41-a5c7-9c998e4c7e83 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.052375 Aug 18 14:56:30.925555 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 428/690] 10.222.0.36 () {62 vars in 1200 bytes} [Thu Aug 18 14:56:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 18 14:56:32.263922 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d5443553-53f1-437a-bd84-381c7d62fd90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-895968655", "imageRef": "4083d76b-6b95-4ed8-8053-69a1270afbd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d06301d-eea8-481d-acc6-eaa13b822797"}], "security_groups": [{"name": "tempest-securitygroup--1584935129"}], "key_name": "tempest-keypair-860120649", "user_data": "}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:56:32.369438 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.network.neutron [None req-d5443553-53f1-437a-bd84-381c7d62fd90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] validate_networks() for [('6d06301d-eea8-481d-acc6-eaa13b822797', None, None, None, None, None)] {{(pid=132268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:56:32.830090 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-d5443553-53f1-437a-bd84-381c7d62fd90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Flavor limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:56:32.830513 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-d5443553-53f1-437a-bd84-381c7d62fd90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Image limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:56:32.831024 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-d5443553-53f1-437a-bd84-381c7d62fd90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Flavor pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:56:32.831462 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-d5443553-53f1-437a-bd84-381c7d62fd90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Image pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:56:32.832053 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-d5443553-53f1-437a-bd84-381c7d62fd90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:56:32.841478 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d5443553-53f1-437a-bd84-381c7d62fd90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:32.841947 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d5443553-53f1-437a-bd84-381c7d62fd90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:32.842373 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d5443553-53f1-437a-bd84-381c7d62fd90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:32.843090 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d5443553-53f1-437a-bd84-381c7d62fd90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:32.843585 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d5443553-53f1-437a-bd84-381c7d62fd90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:32.844050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d5443553-53f1-437a-bd84-381c7d62fd90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:32.863035 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-d5443553-53f1-437a-bd84-381c7d62fd90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Getting quotas for project 594f04dadf2a45fcb5fe2a80744cb9e6. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:56:32.867789 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-d5443553-53f1-437a-bd84-381c7d62fd90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Getting quotas for user 09b055bb15ce4b2ab4276b0090e16122 and project 594f04dadf2a45fcb5fe2a80744cb9e6. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:56:32.879014 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d5443553-53f1-437a-bd84-381c7d62fd90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Going to run 1 instances... {{(pid=132268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:56:32.881932 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d5443553-53f1-437a-bd84-381c7d62fd90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4083d76b-6b95-4ed8-8053-69a1270afbd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:56:32.935054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d5443553-53f1-437a-bd84-381c7d62fd90 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.675850 Aug 18 14:56:32.935769 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 429/691] 10.222.0.36 () {62 vars in 1188 bytes} [Thu Aug 18 14:56:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 18 14:56:32.946966 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8a9d8899-f6f4-49c2-8500-f775dffa6e43 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:32.947809 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-8a9d8899-f6f4-49c2-8500-f775dffa6e43 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:33.016385 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8a9d8899-f6f4-49c2-8500-f775dffa6e43 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:33.021879 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8a9d8899-f6f4-49c2-8500-f775dffa6e43 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:33.023498 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8a9d8899-f6f4-49c2-8500-f775dffa6e43 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:33.024639 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-8a9d8899-f6f4-49c2-8500-f775dffa6e43 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1280 microversion: 2.20 time: 0.082022 Aug 18 14:56:33.025184 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 430/692] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:56:32 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1280 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:56:34.047251 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-6060b428-174f-4ce8-9767-2d5b408fa484 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:34.047904 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-6060b428-174f-4ce8-9767-2d5b408fa484 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:34.055645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6060b428-174f-4ce8-9767-2d5b408fa484 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:34.056143 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6060b428-174f-4ce8-9767-2d5b408fa484 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:34.056566 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6060b428-174f-4ce8-9767-2d5b408fa484 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:34.057469 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6060b428-174f-4ce8-9767-2d5b408fa484 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:34.057919 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6060b428-174f-4ce8-9767-2d5b408fa484 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:34.058336 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6060b428-174f-4ce8-9767-2d5b408fa484 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:34.125266 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6060b428-174f-4ce8-9767-2d5b408fa484 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:34.134443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6060b428-174f-4ce8-9767-2d5b408fa484 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:34.137083 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6060b428-174f-4ce8-9767-2d5b408fa484 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:34.138550 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-6060b428-174f-4ce8-9767-2d5b408fa484 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1332 microversion: 2.20 time: 0.096031 Aug 18 14:56:34.139404 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 431/693] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:56:34 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:56:35.161534 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-615e8ae0-5109-4887-a378-0dfc0f038a71 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:35.162171 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-615e8ae0-5109-4887-a378-0dfc0f038a71 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:35.168625 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-615e8ae0-5109-4887-a378-0dfc0f038a71 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:35.169114 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-615e8ae0-5109-4887-a378-0dfc0f038a71 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:35.169549 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-615e8ae0-5109-4887-a378-0dfc0f038a71 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:35.170310 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-615e8ae0-5109-4887-a378-0dfc0f038a71 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:35.170782 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-615e8ae0-5109-4887-a378-0dfc0f038a71 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:35.171136 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-615e8ae0-5109-4887-a378-0dfc0f038a71 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:35.432296 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-615e8ae0-5109-4887-a378-0dfc0f038a71 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:35.443102 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-615e8ae0-5109-4887-a378-0dfc0f038a71 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:35.444705 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-615e8ae0-5109-4887-a378-0dfc0f038a71 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:35.446020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-615e8ae0-5109-4887-a378-0dfc0f038a71 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1406 microversion: 2.20 time: 0.288392 Aug 18 14:56:35.460080 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 432/694] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:56:35 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1406 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:56:35.743393 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-660b28f8-bf6c-4c07-9a29-fbf0c4f7afd5 req-6d7c3d17-7959-45d4-bc95-d40dd17bf416 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cb0c027-abae-485d-a0b8-c57e5286d2b1", "tag": "982d1ea2-1757-4ef9-9f00-9c88adcab716"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:56:35.754370 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-660b28f8-bf6c-4c07-9a29-fbf0c4f7afd5 req-6d7c3d17-7959-45d4-bc95-d40dd17bf416 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:35.754873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-660b28f8-bf6c-4c07-9a29-fbf0c4f7afd5 req-6d7c3d17-7959-45d4-bc95-d40dd17bf416 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:35.755366 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-660b28f8-bf6c-4c07-9a29-fbf0c4f7afd5 req-6d7c3d17-7959-45d4-bc95-d40dd17bf416 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:35.770798 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-660b28f8-bf6c-4c07-9a29-fbf0c4f7afd5 req-6d7c3d17-7959-45d4-bc95-d40dd17bf416 service nova] Creating event network-changed:982d1ea2-1757-4ef9-9f00-9c88adcab716 for instance 1cb0c027-abae-485d-a0b8-c57e5286d2b1 on hv-cinder-85220 Aug 18 14:56:35.775619 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-660b28f8-bf6c-4c07-9a29-fbf0c4f7afd5 req-6d7c3d17-7959-45d4-bc95-d40dd17bf416 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036766 Aug 18 14:56:35.776241 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 433/695] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:56:36.471136 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0b99ea3e-bc58-4f96-b778-af73656d1eaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:36.472004 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0b99ea3e-bc58-4f96-b778-af73656d1eaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:36.478413 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0b99ea3e-bc58-4f96-b778-af73656d1eaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:36.478892 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0b99ea3e-bc58-4f96-b778-af73656d1eaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:36.479323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0b99ea3e-bc58-4f96-b778-af73656d1eaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:36.480029 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0b99ea3e-bc58-4f96-b778-af73656d1eaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:36.480508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0b99ea3e-bc58-4f96-b778-af73656d1eaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:36.480922 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0b99ea3e-bc58-4f96-b778-af73656d1eaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:36.496417 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:56:36.617155 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-0b99ea3e-bc58-4f96-b778-af73656d1eaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:36.625351 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-0b99ea3e-bc58-4f96-b778-af73656d1eaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:36.626860 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-0b99ea3e-bc58-4f96-b778-af73656d1eaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:36.628010 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0b99ea3e-bc58-4f96-b778-af73656d1eaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1406 microversion: 2.20 time: 0.161865 Aug 18 14:56:36.628563 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 434/696] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:56:36 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:56:37.651306 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-7d36a0b8-504a-4972-87b6-aefe04094881 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:37.652649 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-7d36a0b8-504a-4972-87b6-aefe04094881 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:37.659845 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7d36a0b8-504a-4972-87b6-aefe04094881 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:37.660654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7d36a0b8-504a-4972-87b6-aefe04094881 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:37.661275 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7d36a0b8-504a-4972-87b6-aefe04094881 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:37.661979 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7d36a0b8-504a-4972-87b6-aefe04094881 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:37.662435 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7d36a0b8-504a-4972-87b6-aefe04094881 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:37.662854 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7d36a0b8-504a-4972-87b6-aefe04094881 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:37.885096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-7d36a0b8-504a-4972-87b6-aefe04094881 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:37.895226 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-7d36a0b8-504a-4972-87b6-aefe04094881 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:37.897855 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-7d36a0b8-504a-4972-87b6-aefe04094881 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:37.899292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-7d36a0b8-504a-4972-87b6-aefe04094881 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1406 microversion: 2.20 time: 0.252250 Aug 18 14:56:37.900225 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 435/697] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:56:37 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:56:38.439309 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0c7fefe4-09d1-4021-905f-e1eccee4b46c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:38.441610 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0c7fefe4-09d1-4021-905f-e1eccee4b46c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:38.448205 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0c7fefe4-09d1-4021-905f-e1eccee4b46c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:38.448705 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0c7fefe4-09d1-4021-905f-e1eccee4b46c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:38.449133 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0c7fefe4-09d1-4021-905f-e1eccee4b46c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:38.450125 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0c7fefe4-09d1-4021-905f-e1eccee4b46c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:38.450596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0c7fefe4-09d1-4021-905f-e1eccee4b46c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:38.451024 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0c7fefe4-09d1-4021-905f-e1eccee4b46c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:38.480856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0c7fefe4-09d1-4021-905f-e1eccee4b46c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045369 Aug 18 14:56:38.481409 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 436/698] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Aug 18 14:56:38 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 14:56:38.543489 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f3fce7dd-3d4e-47bc-ba07-d4863b85c6c1 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:38.544024 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f3fce7dd-3d4e-47bc-ba07-d4863b85c6c1 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:38.549955 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f3fce7dd-3d4e-47bc-ba07-d4863b85c6c1 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:38.550444 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f3fce7dd-3d4e-47bc-ba07-d4863b85c6c1 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:38.550882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f3fce7dd-3d4e-47bc-ba07-d4863b85c6c1 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:38.551570 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f3fce7dd-3d4e-47bc-ba07-d4863b85c6c1 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:38.552230 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f3fce7dd-3d4e-47bc-ba07-d4863b85c6c1 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:38.552659 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f3fce7dd-3d4e-47bc-ba07-d4863b85c6c1 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:38.577037 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f3fce7dd-3d4e-47bc-ba07-d4863b85c6c1 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Going to try to terminate instance {{(pid=132268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:56:38.656860 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f3fce7dd-3d4e-47bc-ba07-d4863b85c6c1 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 204 len: 0 microversion: 2.1 time: 0.116189 Aug 18 14:56:38.657847 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 437/699] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 14:56:38 2022] DELETE /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 14:56:38.668498 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c9f48647-4a45-4134-9396-ec2e45726509 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:38.669475 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c9f48647-4a45-4134-9396-ec2e45726509 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:38.676108 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c9f48647-4a45-4134-9396-ec2e45726509 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:38.676592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c9f48647-4a45-4134-9396-ec2e45726509 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:38.677519 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c9f48647-4a45-4134-9396-ec2e45726509 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:38.678208 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c9f48647-4a45-4134-9396-ec2e45726509 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:38.678663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c9f48647-4a45-4134-9396-ec2e45726509 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:38.679088 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c9f48647-4a45-4134-9396-ec2e45726509 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:38.811882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c9f48647-4a45-4134-9396-ec2e45726509 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:38.819616 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c9f48647-4a45-4134-9396-ec2e45726509 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1673 microversion: 2.1 time: 0.155866 Aug 18 14:56:38.820186 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 438/700] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:38 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:56:38.921456 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e0ad5344-1f6c-40c8-bbd3-ee3f1ad41b65 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:38.921992 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e0ad5344-1f6c-40c8-bbd3-ee3f1ad41b65 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:38.928712 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e0ad5344-1f6c-40c8-bbd3-ee3f1ad41b65 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:38.929189 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e0ad5344-1f6c-40c8-bbd3-ee3f1ad41b65 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:38.929618 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e0ad5344-1f6c-40c8-bbd3-ee3f1ad41b65 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:38.930308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e0ad5344-1f6c-40c8-bbd3-ee3f1ad41b65 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:38.930755 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e0ad5344-1f6c-40c8-bbd3-ee3f1ad41b65 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:38.931187 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e0ad5344-1f6c-40c8-bbd3-ee3f1ad41b65 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:39.058960 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e0ad5344-1f6c-40c8-bbd3-ee3f1ad41b65 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:39.067249 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e0ad5344-1f6c-40c8-bbd3-ee3f1ad41b65 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:39.069081 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e0ad5344-1f6c-40c8-bbd3-ee3f1ad41b65 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:39.070177 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e0ad5344-1f6c-40c8-bbd3-ee3f1ad41b65 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1406 microversion: 2.20 time: 0.152687 Aug 18 14:56:39.070726 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 439/701] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:56:38 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:56:39.677714 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-4fc03e3b-e171-47c3-a125-49a51bc72e1f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc24f99d-2752-4fc1-afee-621294774608"}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:56:39.680078 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-4fc03e3b-e171-47c3-a125-49a51bc72e1f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:39.686602 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4fc03e3b-e171-47c3-a125-49a51bc72e1f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:39.687093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4fc03e3b-e171-47c3-a125-49a51bc72e1f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:39.687531 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4fc03e3b-e171-47c3-a125-49a51bc72e1f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:39.688256 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4fc03e3b-e171-47c3-a125-49a51bc72e1f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:39.688751 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4fc03e3b-e171-47c3-a125-49a51bc72e1f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:39.689162 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4fc03e3b-e171-47c3-a125-49a51bc72e1f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:40.824936 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-4fc03e3b-e171-47c3-a125-49a51bc72e1f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "POST /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.151054 Aug 18 14:56:40.825601 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 440/702] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Aug 18 14:56:39 2022] POST /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/os-volume_attachments => generated 194 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:56:40.974738 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: Traceback (most recent call last): Aug 18 14:56:40.975298 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 18 14:56:40.975298 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: timer() Aug 18 14:56:40.975298 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 18 14:56:40.975298 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: cb(*args, **kw) Aug 18 14:56:40.975298 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Aug 18 14:56:40.975298 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: waiter.switch() Aug 18 14:56:40.975298 dv-cinder-852208-7-iscsi devstack@n-api.service[132267]: greenlet.error: cannot switch to a different thread Aug 18 14:56:41.059291 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-55d79143-ba94-4acb-a1f0-4d5e8aae29b9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:41.060023 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-55d79143-ba94-4acb-a1f0-4d5e8aae29b9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:41.061954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:56:41.068966 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-55d79143-ba94-4acb-a1f0-4d5e8aae29b9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:41.069448 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-55d79143-ba94-4acb-a1f0-4d5e8aae29b9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:41.070027 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-55d79143-ba94-4acb-a1f0-4d5e8aae29b9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:41.070840 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-55d79143-ba94-4acb-a1f0-4d5e8aae29b9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:41.071294 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-55d79143-ba94-4acb-a1f0-4d5e8aae29b9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:41.071740 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-55d79143-ba94-4acb-a1f0-4d5e8aae29b9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:41.294317 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-55d79143-ba94-4acb-a1f0-4d5e8aae29b9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:41.303338 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-55d79143-ba94-4acb-a1f0-4d5e8aae29b9 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1673 microversion: 2.1 time: 0.476647 Aug 18 14:56:41.303973 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 441/703] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:40 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1673 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:56:41.423224 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3e4cd355-c1b6-4ec3-bd6b-f31c7f1c14b1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:41.423873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-3e4cd355-c1b6-4ec3-bd6b-f31c7f1c14b1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:41.430372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3e4cd355-c1b6-4ec3-bd6b-f31c7f1c14b1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:41.431087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3e4cd355-c1b6-4ec3-bd6b-f31c7f1c14b1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:41.431556 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3e4cd355-c1b6-4ec3-bd6b-f31c7f1c14b1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:41.432325 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3e4cd355-c1b6-4ec3-bd6b-f31c7f1c14b1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:41.432814 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3e4cd355-c1b6-4ec3-bd6b-f31c7f1c14b1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:41.433245 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3e4cd355-c1b6-4ec3-bd6b-f31c7f1c14b1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:41.655174 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-3e4cd355-c1b6-4ec3-bd6b-f31c7f1c14b1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:41.664117 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-3e4cd355-c1b6-4ec3-bd6b-f31c7f1c14b1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:41.665613 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-3e4cd355-c1b6-4ec3-bd6b-f31c7f1c14b1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:41.666724 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-3e4cd355-c1b6-4ec3-bd6b-f31c7f1c14b1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1406 microversion: 2.20 time: 0.361839 Aug 18 14:56:41.667341 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 442/704] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:56:41 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1406 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:56:41.859430 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-f49b397e-ec0d-45ea-a3c5-283e9b72cdd5 req-5f403120-c1c2-49b3-81bd-b92991a94b09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cb0c027-abae-485d-a0b8-c57e5286d2b1", "name": "network-vif-plugged", "status": "completed", "tag": "982d1ea2-1757-4ef9-9f00-9c88adcab716"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:56:41.871091 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-f49b397e-ec0d-45ea-a3c5-283e9b72cdd5 req-5f403120-c1c2-49b3-81bd-b92991a94b09 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:41.871863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-f49b397e-ec0d-45ea-a3c5-283e9b72cdd5 req-5f403120-c1c2-49b3-81bd-b92991a94b09 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:41.872373 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-f49b397e-ec0d-45ea-a3c5-283e9b72cdd5 req-5f403120-c1c2-49b3-81bd-b92991a94b09 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:41.885760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-f49b397e-ec0d-45ea-a3c5-283e9b72cdd5 req-5f403120-c1c2-49b3-81bd-b92991a94b09 service nova] Creating event network-vif-plugged:982d1ea2-1757-4ef9-9f00-9c88adcab716 for instance 1cb0c027-abae-485d-a0b8-c57e5286d2b1 on hv-cinder-85220 Aug 18 14:56:41.891907 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-f49b397e-ec0d-45ea-a3c5-283e9b72cdd5 req-5f403120-c1c2-49b3-81bd-b92991a94b09 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036677 Aug 18 14:56:41.892824 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 443/705] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:56:42.101373 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-67ef1043-b656-4534-a0e4-db80a58e3216 req-56971dc1-2c54-4f30-8fb6-ae956e650291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9d85d35-e080-4901-a147-87b0aaf6c5e5", "name": "network-vif-deleted", "tag": "8ef940b0-b304-4979-ad53-fd987e997f5f"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:56:42.113229 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-67ef1043-b656-4534-a0e4-db80a58e3216 req-56971dc1-2c54-4f30-8fb6-ae956e650291 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:42.113774 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-67ef1043-b656-4534-a0e4-db80a58e3216 req-56971dc1-2c54-4f30-8fb6-ae956e650291 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:42.115024 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-67ef1043-b656-4534-a0e4-db80a58e3216 req-56971dc1-2c54-4f30-8fb6-ae956e650291 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:42.130630 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-67ef1043-b656-4534-a0e4-db80a58e3216 req-56971dc1-2c54-4f30-8fb6-ae956e650291 service nova] Creating event network-vif-deleted:8ef940b0-b304-4979-ad53-fd987e997f5f for instance c9d85d35-e080-4901-a147-87b0aaf6c5e5 on hv-cinder-85220 Aug 18 14:56:42.136714 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-67ef1043-b656-4534-a0e4-db80a58e3216 req-56971dc1-2c54-4f30-8fb6-ae956e650291 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039234 Aug 18 14:56:42.142332 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 444/706] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:56:42.325470 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-36182ff3-9385-4b82-a0bf-83f18f1b5bb4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:42.327346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-36182ff3-9385-4b82-a0bf-83f18f1b5bb4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:42.336337 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-36182ff3-9385-4b82-a0bf-83f18f1b5bb4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:42.337122 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-36182ff3-9385-4b82-a0bf-83f18f1b5bb4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:42.338315 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-36182ff3-9385-4b82-a0bf-83f18f1b5bb4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:42.339522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-36182ff3-9385-4b82-a0bf-83f18f1b5bb4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:42.340672 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-36182ff3-9385-4b82-a0bf-83f18f1b5bb4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:42.341269 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-36182ff3-9385-4b82-a0bf-83f18f1b5bb4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:42.376295 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-36182ff3-9385-4b82-a0bf-83f18f1b5bb4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:42.376841 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-36182ff3-9385-4b82-a0bf-83f18f1b5bb4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:42.377277 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-36182ff3-9385-4b82-a0bf-83f18f1b5bb4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:42.377792 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.objects.instance [None req-36182ff3-9385-4b82-a0bf-83f18f1b5bb4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lazy-loading 'fault' on Instance uuid c9d85d35-e080-4901-a147-87b0aaf6c5e5 {{(pid=132268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:56:42.423369 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-36182ff3-9385-4b82-a0bf-83f18f1b5bb4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:42.431364 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-36182ff3-9385-4b82-a0bf-83f18f1b5bb4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 200 len: 1326 microversion: 2.1 time: 0.110443 Aug 18 14:56:42.431887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 445/707] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:42 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 1326 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:56:42.688416 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-66742161-2999-4663-a368-4f175635a151 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:42.689105 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-66742161-2999-4663-a368-4f175635a151 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:42.695479 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-66742161-2999-4663-a368-4f175635a151 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:42.695998 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-66742161-2999-4663-a368-4f175635a151 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:42.696437 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-66742161-2999-4663-a368-4f175635a151 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:42.697133 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-66742161-2999-4663-a368-4f175635a151 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:42.697584 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-66742161-2999-4663-a368-4f175635a151 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:42.698009 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-66742161-2999-4663-a368-4f175635a151 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:42.834700 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-66742161-2999-4663-a368-4f175635a151 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:42.843933 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-66742161-2999-4663-a368-4f175635a151 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:42.845444 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-66742161-2999-4663-a368-4f175635a151 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:42.846570 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-66742161-2999-4663-a368-4f175635a151 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1406 microversion: 2.20 time: 0.162218 Aug 18 14:56:42.847123 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 446/708] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:56:42 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:56:43.455267 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0626a013-8980-4699-bf05-d5dd06cca011 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:43.456700 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0626a013-8980-4699-bf05-d5dd06cca011 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:43.461027 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=2 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:56:43.463619 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=12 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:56:43.473511 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0626a013-8980-4699-bf05-d5dd06cca011 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:43.474094 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0626a013-8980-4699-bf05-d5dd06cca011 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:43.474526 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0626a013-8980-4699-bf05-d5dd06cca011 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:43.475223 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0626a013-8980-4699-bf05-d5dd06cca011 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:43.475672 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0626a013-8980-4699-bf05-d5dd06cca011 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:43.476448 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0626a013-8980-4699-bf05-d5dd06cca011 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:43.490661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-0626a013-8980-4699-bf05-d5dd06cca011 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] HTTP exception thrown: Instance c9d85d35-e080-4901-a147-87b0aaf6c5e5 could not be found. Aug 18 14:56:43.492323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0626a013-8980-4699-bf05-d5dd06cca011 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Request method failure captured: Aug 18 14:56:43.492323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 HTTP/1.1 Aug 18 14:56:43.492323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:56:43.492323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:56:43.492323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:56:43.492323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:56:43.492323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:56:43.492323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:56:43.492323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:56:43.492323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:56:43.492323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lH6BHXVVBz2bu2oI3N3lrYFUqap7g77I0qAQBxIqrO1qLF-L7AUzm1M2x4z2taZt045DURIw-nP_XJaZMwll8Au7wbfViaB3bev4Rw3_1RoqYXCk-UmoN76amBPnEJzgxY_Z3LPB7uMqWQN-lS61umlU4Vf17CSZL26XcnP1HzHBRU Aug 18 14:56:43.492323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:56:43.492323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:56:43.492323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:56:43.492323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:56:43.492323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:56:43.492323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:56:43.492323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: bde4e338430442449fcc203cd9493bc3 Aug 18 14:56:43.492323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-AttachVolumeTestJSON-1688587655 Aug 18 14:56:43.492323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:56:43.492323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:56:43.493938 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bde4e338430442449fcc203cd9493bc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bde4e338430442449fcc203cd9493bc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bde4e338430442449fcc203cd9493bc3", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bde4e338430442449fcc203cd9493bc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:56:43.493938 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-AttachVolumeTestJSON-1688587655 Aug 18 14:56:43.493938 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: bde4e338430442449fcc203cd9493bc3 Aug 18 14:56:43.493938 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1688587655 Aug 18 14:56:43.493938 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-AttachVolumeTestJSON-1688587655-project Aug 18 14:56:43.493938 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:56:43.493938 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:56:43.493938 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 4d96208474754b2381d769d807689bbb Aug 18 14:56:43.493938 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-AttachVolumeTestJSON-1688587655-project Aug 18 14:56:43.493938 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:56:43.493938 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance c9d85d35-e080-4901-a147-87b0aaf6c5e5 could not be found. Aug 18 14:56:43.493938 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': 'c9d85d35-e080-4901-a147-87b0aaf6c5e5'} Aug 18 14:56:43.495020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:56:43.495020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:56:43.495020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:56:43.495020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:56:43.495020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:56:43.495020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:56:43.495020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:56:43.495020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:56:43.495020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:56:43.495020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:56:43.495020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9d85d35-e080-4901-a147-87b0aaf6c5e5 could not be found. Aug 18 14:56:43.495020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:56:43.495020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:56:43.495020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:56:43.495020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:56:43.495020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:56:43.495020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:56:43.495020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:56:43.495020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:56:43.495020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:56:43.496571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:56:43.496571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:56:43.496571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:56:43.496571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:56:43.496571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:56:43.496571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:56:43.496571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:56:43.496571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9d85d35-e080-4901-a147-87b0aaf6c5e5 could not be found. Aug 18 14:56:43.496571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:56:43.496571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:56:43.496571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:56:43.496571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:56:43.496571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:56:43.496571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:56:43.496571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:56:43.496571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:56:43.496571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9d85d35-e080-4901-a147-87b0aaf6c5e5 could not be found. Aug 18 14:56:43.496571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:56:43.498066 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0626a013-8980-4699-bf05-d5dd06cca011 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Returning 404 to user: Instance c9d85d35-e080-4901-a147-87b0aaf6c5e5 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:56:43.498066 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0626a013-8980-4699-bf05-d5dd06cca011 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 404 len: 111 microversion: 2.1 time: 0.043398 Aug 18 14:56:43.498066 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 447/709] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:43 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 14:56:43.502327 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-67611a98-6574-4bf9-bc32-7d62f047b986 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '.version_select at 0x7fb21403a280>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:43.522126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-67611a98-6574-4bf9-bc32-7d62f047b986 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-508715999" status: 202 len: 0 microversion: 2.1 time: 0.023391 Aug 18 14:56:43.522670 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 448/710] 10.222.0.36 () {58 vars in 1218 bytes} [Thu Aug 18 14:56:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-508715999 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:56:43.870144 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-89d8187d-9a44-4613-becd-58a3c460ffeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:43.870813 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-89d8187d-9a44-4613-becd-58a3c460ffeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:43.877493 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-89d8187d-9a44-4613-becd-58a3c460ffeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:43.877832 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-89d8187d-9a44-4613-becd-58a3c460ffeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:43.878262 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-89d8187d-9a44-4613-becd-58a3c460ffeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:43.879236 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-89d8187d-9a44-4613-becd-58a3c460ffeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:43.879923 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-89d8187d-9a44-4613-becd-58a3c460ffeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:43.880889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-89d8187d-9a44-4613-becd-58a3c460ffeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:44.067301 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-89d8187d-9a44-4613-becd-58a3c460ffeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:44.075784 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-89d8187d-9a44-4613-becd-58a3c460ffeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:44.078573 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-89d8187d-9a44-4613-becd-58a3c460ffeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:44.079838 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-89d8187d-9a44-4613-becd-58a3c460ffeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1406 microversion: 2.20 time: 0.213575 Aug 18 14:56:44.080491 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 449/711] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:56:43 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:56:44.209891 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f05f6cd3-5a64-4a68-b0aa-c4e0e6a88163 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Action: 'create', calling method: .version_select at 0x7fb21403a4c0>, body: {"keypair": {"name": "tempest-keypair-1438896663", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBReyuQXVzb8cGa6S/i3nKmeBIdqZJJQmDR06VC1aHMKpthfVVcipe6blEz9HZB8IrjITMU9xYdW6J99O+Gzuq7pblkV9jBT5I5DlZSZ6bW08ZH7RNGxEir+p9ynVnCOVQ=="}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:56:44.227375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-f05f6cd3-5a64-4a68-b0aa-c4e0e6a88163 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Getting quotas for project bde4e338430442449fcc203cd9493bc3. Resources: {'key_pairs'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:56:44.231586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-f05f6cd3-5a64-4a68-b0aa-c4e0e6a88163 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Getting quotas for user 4d96208474754b2381d769d807689bbb and project bde4e338430442449fcc203cd9493bc3. Resources: {'key_pairs'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:56:44.256100 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f05f6cd3-5a64-4a68-b0aa-c4e0e6a88163 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050143 Aug 18 14:56:44.257609 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 450/712] 10.222.0.36 () {60 vars in 1159 bytes} [Thu Aug 18 14:56:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:56:45.103186 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0d8e2607-b887-4a65-99d1-2ec0c25c4c6c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:45.104541 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0d8e2607-b887-4a65-99d1-2ec0c25c4c6c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:45.110679 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0d8e2607-b887-4a65-99d1-2ec0c25c4c6c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:45.111194 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0d8e2607-b887-4a65-99d1-2ec0c25c4c6c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:45.111625 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0d8e2607-b887-4a65-99d1-2ec0c25c4c6c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:45.112347 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0d8e2607-b887-4a65-99d1-2ec0c25c4c6c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:45.112801 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0d8e2607-b887-4a65-99d1-2ec0c25c4c6c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:45.113222 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0d8e2607-b887-4a65-99d1-2ec0c25c4c6c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:45.259115 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-0d8e2607-b887-4a65-99d1-2ec0c25c4c6c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:45.261689 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:56:45.270402 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-0d8e2607-b887-4a65-99d1-2ec0c25c4c6c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:45.272802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-0d8e2607-b887-4a65-99d1-2ec0c25c4c6c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:45.274046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0d8e2607-b887-4a65-99d1-2ec0c25c4c6c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1597 microversion: 2.20 time: 0.175501 Aug 18 14:56:45.274608 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 451/713] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:56:45 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1597 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:56:45.296651 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-12645339-18ac-4bf6-a846-c7f323f4f05f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:45.297066 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-12645339-18ac-4bf6-a846-c7f323f4f05f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:45.304746 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-12645339-18ac-4bf6-a846-c7f323f4f05f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:45.305231 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-12645339-18ac-4bf6-a846-c7f323f4f05f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:45.305670 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-12645339-18ac-4bf6-a846-c7f323f4f05f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:45.306380 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-12645339-18ac-4bf6-a846-c7f323f4f05f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:45.306822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-12645339-18ac-4bf6-a846-c7f323f4f05f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:45.307241 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-12645339-18ac-4bf6-a846-c7f323f4f05f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:45.389855 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-12645339-18ac-4bf6-a846-c7f323f4f05f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.097196 Aug 18 14:56:45.390493 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 452/714] 10.222.0.36 () {60 vars in 1316 bytes} [Thu Aug 18 14:56:45 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 14:56:45.494433 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f2d1e068-0143-4818-94a4-bc621e49647e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1699466649", "imageRef": "4083d76b-6b95-4ed8-8053-69a1270afbd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b4322c5-3837-461a-95c5-d4672de016b3"}], "security_groups": [{"name": "tempest-securitygroup--612575987"}], "key_name": "tempest-keypair-1438896663", "user_data": "}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:56:45.877529 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.network.neutron [None req-f2d1e068-0143-4818-94a4-bc621e49647e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] validate_networks() for [('7b4322c5-3837-461a-95c5-d4672de016b3', None, None, None, None, None)] {{(pid=132268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:56:46.659048 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-f2d1e068-0143-4818-94a4-bc621e49647e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Flavor limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:56:46.660351 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-f2d1e068-0143-4818-94a4-bc621e49647e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Image limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:56:46.660828 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-f2d1e068-0143-4818-94a4-bc621e49647e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Flavor pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:56:46.661790 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-f2d1e068-0143-4818-94a4-bc621e49647e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Image pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:56:46.662202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-f2d1e068-0143-4818-94a4-bc621e49647e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:56:46.671194 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f2d1e068-0143-4818-94a4-bc621e49647e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:46.671671 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f2d1e068-0143-4818-94a4-bc621e49647e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:46.672136 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f2d1e068-0143-4818-94a4-bc621e49647e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:46.672855 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f2d1e068-0143-4818-94a4-bc621e49647e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:46.673306 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f2d1e068-0143-4818-94a4-bc621e49647e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:46.673724 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f2d1e068-0143-4818-94a4-bc621e49647e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:46.692487 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-f2d1e068-0143-4818-94a4-bc621e49647e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Getting quotas for project bde4e338430442449fcc203cd9493bc3. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:56:46.697215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-f2d1e068-0143-4818-94a4-bc621e49647e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Getting quotas for user 4d96208474754b2381d769d807689bbb and project bde4e338430442449fcc203cd9493bc3. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:56:46.709783 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f2d1e068-0143-4818-94a4-bc621e49647e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Going to run 1 instances... {{(pid=132268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:56:46.712280 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f2d1e068-0143-4818-94a4-bc621e49647e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4083d76b-6b95-4ed8-8053-69a1270afbd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:56:46.762199 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f2d1e068-0143-4818-94a4-bc621e49647e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.279335 Aug 18 14:56:46.769365 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 453/715] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Aug 18 14:56:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 1281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 14:56:46.776660 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3f58d9fd-66d6-4a3a-a28f-8acce80afcb5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:46.777401 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-3f58d9fd-66d6-4a3a-a28f-8acce80afcb5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:46.846575 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-3f58d9fd-66d6-4a3a-a28f-8acce80afcb5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:46.854336 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-3f58d9fd-66d6-4a3a-a28f-8acce80afcb5 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303" status: 200 len: 1238 microversion: 2.1 time: 0.081695 Aug 18 14:56:46.867917 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 454/716] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:46 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303 => generated 1238 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:56:47.012228 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-e4f3a815-c6d4-4550-8862-665ab1d6a27d req-675d4bcf-1241-431c-b2ad-60cd410f9b42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cb0c027-abae-485d-a0b8-c57e5286d2b1", "tag": "982d1ea2-1757-4ef9-9f00-9c88adcab716"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:56:47.022317 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-e4f3a815-c6d4-4550-8862-665ab1d6a27d req-675d4bcf-1241-431c-b2ad-60cd410f9b42 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:47.023014 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-e4f3a815-c6d4-4550-8862-665ab1d6a27d req-675d4bcf-1241-431c-b2ad-60cd410f9b42 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:47.023629 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-e4f3a815-c6d4-4550-8862-665ab1d6a27d req-675d4bcf-1241-431c-b2ad-60cd410f9b42 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:47.035137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-e4f3a815-c6d4-4550-8862-665ab1d6a27d req-675d4bcf-1241-431c-b2ad-60cd410f9b42 service nova] Creating event network-changed:982d1ea2-1757-4ef9-9f00-9c88adcab716 for instance 1cb0c027-abae-485d-a0b8-c57e5286d2b1 on hv-cinder-85220 Aug 18 14:56:47.041065 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-e4f3a815-c6d4-4550-8862-665ab1d6a27d req-675d4bcf-1241-431c-b2ad-60cd410f9b42 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034923 Aug 18 14:56:47.041861 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 455/717] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:56:47.875726 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3bcb2ef1-930f-44aa-8e7b-ff9709573483 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:47.876498 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-3bcb2ef1-930f-44aa-8e7b-ff9709573483 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:47.883929 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3bcb2ef1-930f-44aa-8e7b-ff9709573483 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:47.884446 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3bcb2ef1-930f-44aa-8e7b-ff9709573483 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:47.884875 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3bcb2ef1-930f-44aa-8e7b-ff9709573483 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:47.885582 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3bcb2ef1-930f-44aa-8e7b-ff9709573483 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:47.886038 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3bcb2ef1-930f-44aa-8e7b-ff9709573483 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:47.886728 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3bcb2ef1-930f-44aa-8e7b-ff9709573483 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:47.956789 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-3bcb2ef1-930f-44aa-8e7b-ff9709573483 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:47.965227 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-3bcb2ef1-930f-44aa-8e7b-ff9709573483 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303" status: 200 len: 1290 microversion: 2.1 time: 0.094409 Aug 18 14:56:47.966315 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 456/718] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:47 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303 => generated 1290 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:56:48.419305 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d8e159fe-f0ec-4b33-8564-23c11ccfbbfa tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:56:48.421898 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d8e159fe-f0ec-4b33-8564-23c11ccfbbfa tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:48.428482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d8e159fe-f0ec-4b33-8564-23c11ccfbbfa tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:48.429206 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d8e159fe-f0ec-4b33-8564-23c11ccfbbfa tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:48.429818 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d8e159fe-f0ec-4b33-8564-23c11ccfbbfa tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:48.430701 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d8e159fe-f0ec-4b33-8564-23c11ccfbbfa tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:48.431314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d8e159fe-f0ec-4b33-8564-23c11ccfbbfa tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:48.432108 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d8e159fe-f0ec-4b33-8564-23c11ccfbbfa tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:48.456765 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.objects.instance [None req-d8e159fe-f0ec-4b33-8564-23c11ccfbbfa tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lazy-loading 'flavor' on Instance uuid d9163961-387b-4e9b-94a8-9647dde7c208 {{(pid=132268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:56:48.579724 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d8e159fe-f0ec-4b33-8564-23c11ccfbbfa tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "POST /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/action" status: 200 len: 32 microversion: 2.1 time: 0.164231 Aug 18 14:56:48.580749 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 457/719] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Aug 18 14:56:48 2022] POST /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/action => generated 32 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 14:56:48.591205 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c05b03ef-3c66-4b0d-b5a4-2e4204a2c0d0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:48.591936 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c05b03ef-3c66-4b0d-b5a4-2e4204a2c0d0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:48.599981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c05b03ef-3c66-4b0d-b5a4-2e4204a2c0d0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:48.600463 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c05b03ef-3c66-4b0d-b5a4-2e4204a2c0d0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:48.600951 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c05b03ef-3c66-4b0d-b5a4-2e4204a2c0d0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:48.601762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c05b03ef-3c66-4b0d-b5a4-2e4204a2c0d0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:48.602281 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c05b03ef-3c66-4b0d-b5a4-2e4204a2c0d0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:48.602610 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c05b03ef-3c66-4b0d-b5a4-2e4204a2c0d0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:49.023375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c05b03ef-3c66-4b0d-b5a4-2e4204a2c0d0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:49.033329 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c05b03ef-3c66-4b0d-b5a4-2e4204a2c0d0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1735 microversion: 2.1 time: 0.447097 Aug 18 14:56:49.034069 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 458/720] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:48 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1735 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:56:49.039370 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-260285fe-1e6c-4ef0-ad11-f3e7f16dc3ec tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:49.040253 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-260285fe-1e6c-4ef0-ad11-f3e7f16dc3ec tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:49.046531 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-260285fe-1e6c-4ef0-ad11-f3e7f16dc3ec tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:49.047255 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-260285fe-1e6c-4ef0-ad11-f3e7f16dc3ec tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:49.047943 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-260285fe-1e6c-4ef0-ad11-f3e7f16dc3ec tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:49.048752 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-260285fe-1e6c-4ef0-ad11-f3e7f16dc3ec tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:49.049274 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-260285fe-1e6c-4ef0-ad11-f3e7f16dc3ec tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:49.049799 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-260285fe-1e6c-4ef0-ad11-f3e7f16dc3ec tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:49.136784 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-260285fe-1e6c-4ef0-ad11-f3e7f16dc3ec tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:49.146459 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-260285fe-1e6c-4ef0-ad11-f3e7f16dc3ec tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303" status: 200 len: 1296 microversion: 2.1 time: 0.110584 Aug 18 14:56:49.147612 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 459/721] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:49 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303 => generated 1296 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:56:50.054354 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-20b5b0f4-d606-41db-a293-14f977c7ac9b req-8a5568fb-e6a1-4edd-8f08-8dc77325e9c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0587b3b6-bb0f-443b-8b28-0035ad738303", "tag": "873d5f42-d16f-439c-afa0-71e8f2a27384"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:56:50.064995 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-20b5b0f4-d606-41db-a293-14f977c7ac9b req-8a5568fb-e6a1-4edd-8f08-8dc77325e9c3 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:50.065612 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-20b5b0f4-d606-41db-a293-14f977c7ac9b req-8a5568fb-e6a1-4edd-8f08-8dc77325e9c3 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:50.066247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-20b5b0f4-d606-41db-a293-14f977c7ac9b req-8a5568fb-e6a1-4edd-8f08-8dc77325e9c3 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:50.078110 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-20b5b0f4-d606-41db-a293-14f977c7ac9b req-8a5568fb-e6a1-4edd-8f08-8dc77325e9c3 service nova] Creating event network-changed:873d5f42-d16f-439c-afa0-71e8f2a27384 for instance 0587b3b6-bb0f-443b-8b28-0035ad738303 on hv-cinder-85220 Aug 18 14:56:50.082722 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-20b5b0f4-d606-41db-a293-14f977c7ac9b req-8a5568fb-e6a1-4edd-8f08-8dc77325e9c3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032555 Aug 18 14:56:50.083496 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 460/722] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:56:50.088913 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-9b597042-e9a4-4016-8262-55bfad40c704 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:50.089612 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-9b597042-e9a4-4016-8262-55bfad40c704 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:50.096239 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9b597042-e9a4-4016-8262-55bfad40c704 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:50.096730 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9b597042-e9a4-4016-8262-55bfad40c704 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:50.097218 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9b597042-e9a4-4016-8262-55bfad40c704 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:50.097929 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9b597042-e9a4-4016-8262-55bfad40c704 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:50.098381 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9b597042-e9a4-4016-8262-55bfad40c704 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:50.099814 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9b597042-e9a4-4016-8262-55bfad40c704 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:50.326826 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-9b597042-e9a4-4016-8262-55bfad40c704 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:50.335396 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-9b597042-e9a4-4016-8262-55bfad40c704 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1735 microversion: 2.1 time: 0.250603 Aug 18 14:56:50.336009 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 461/723] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:50 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1735 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:56:50.340535 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-62e6c99a-f397-4b83-8cc7-f1544be31d0e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:50.341152 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-62e6c99a-f397-4b83-8cc7-f1544be31d0e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:50.347314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-62e6c99a-f397-4b83-8cc7-f1544be31d0e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:50.347957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-62e6c99a-f397-4b83-8cc7-f1544be31d0e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:50.349013 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-62e6c99a-f397-4b83-8cc7-f1544be31d0e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:50.349827 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-62e6c99a-f397-4b83-8cc7-f1544be31d0e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:50.350403 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-62e6c99a-f397-4b83-8cc7-f1544be31d0e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:50.350949 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-62e6c99a-f397-4b83-8cc7-f1544be31d0e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:50.563477 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-62e6c99a-f397-4b83-8cc7-f1544be31d0e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:50.571416 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-62e6c99a-f397-4b83-8cc7-f1544be31d0e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303" status: 200 len: 1363 microversion: 2.1 time: 0.234411 Aug 18 14:56:50.572017 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 462/724] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:50 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303 => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:56:51.358738 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-72336c50-c7e0-4124-80ef-961c3b358e31 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:51.359449 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-72336c50-c7e0-4124-80ef-961c3b358e31 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:51.365962 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-72336c50-c7e0-4124-80ef-961c3b358e31 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:51.366447 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-72336c50-c7e0-4124-80ef-961c3b358e31 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:51.366885 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-72336c50-c7e0-4124-80ef-961c3b358e31 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:51.367577 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-72336c50-c7e0-4124-80ef-961c3b358e31 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:51.368061 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-72336c50-c7e0-4124-80ef-961c3b358e31 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:51.368489 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-72336c50-c7e0-4124-80ef-961c3b358e31 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:51.497524 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-72336c50-c7e0-4124-80ef-961c3b358e31 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:51.506514 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-72336c50-c7e0-4124-80ef-961c3b358e31 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1735 microversion: 2.1 time: 0.151695 Aug 18 14:56:51.507073 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 463/725] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:51 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:56:51.593123 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d240b081-24ca-4856-b4f0-561b77c81a8e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:51.593734 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d240b081-24ca-4856-b4f0-561b77c81a8e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:51.600264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d240b081-24ca-4856-b4f0-561b77c81a8e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:51.600741 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d240b081-24ca-4856-b4f0-561b77c81a8e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:51.601177 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d240b081-24ca-4856-b4f0-561b77c81a8e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:51.601858 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d240b081-24ca-4856-b4f0-561b77c81a8e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:51.602309 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d240b081-24ca-4856-b4f0-561b77c81a8e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:51.602730 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d240b081-24ca-4856-b4f0-561b77c81a8e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:51.766943 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d240b081-24ca-4856-b4f0-561b77c81a8e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:51.774868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d240b081-24ca-4856-b4f0-561b77c81a8e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303" status: 200 len: 1363 microversion: 2.1 time: 0.185550 Aug 18 14:56:51.775446 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 464/726] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:51 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:56:52.527930 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-fb84f5a5-7dd4-41aa-b700-9820001da8e0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:52.528607 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-fb84f5a5-7dd4-41aa-b700-9820001da8e0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:52.535103 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fb84f5a5-7dd4-41aa-b700-9820001da8e0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:52.535598 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fb84f5a5-7dd4-41aa-b700-9820001da8e0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:52.536557 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fb84f5a5-7dd4-41aa-b700-9820001da8e0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:52.537262 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fb84f5a5-7dd4-41aa-b700-9820001da8e0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:52.537718 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fb84f5a5-7dd4-41aa-b700-9820001da8e0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:52.538144 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fb84f5a5-7dd4-41aa-b700-9820001da8e0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:52.677389 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-fb84f5a5-7dd4-41aa-b700-9820001da8e0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:52.686055 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-fb84f5a5-7dd4-41aa-b700-9820001da8e0 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1735 microversion: 2.1 time: 0.162042 Aug 18 14:56:52.686716 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 465/727] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:52 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:56:52.795662 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0cbf43a4-cec4-4add-9969-a1c3d198f28b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:52.796211 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0cbf43a4-cec4-4add-9969-a1c3d198f28b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:52.802163 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0cbf43a4-cec4-4add-9969-a1c3d198f28b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:52.802636 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0cbf43a4-cec4-4add-9969-a1c3d198f28b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:52.803063 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0cbf43a4-cec4-4add-9969-a1c3d198f28b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:52.803771 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0cbf43a4-cec4-4add-9969-a1c3d198f28b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:52.804221 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0cbf43a4-cec4-4add-9969-a1c3d198f28b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:52.804637 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0cbf43a4-cec4-4add-9969-a1c3d198f28b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:52.933603 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-0cbf43a4-cec4-4add-9969-a1c3d198f28b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:52.941281 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0cbf43a4-cec4-4add-9969-a1c3d198f28b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303" status: 200 len: 1363 microversion: 2.1 time: 0.149534 Aug 18 14:56:52.941841 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 466/728] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:52 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:56:53.168873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-7cc3afed-773d-4490-8b91-40df9654e606 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:53.169362 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-7cc3afed-773d-4490-8b91-40df9654e606 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:53.175418 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7cc3afed-773d-4490-8b91-40df9654e606 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:53.175923 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7cc3afed-773d-4490-8b91-40df9654e606 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:53.176352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7cc3afed-773d-4490-8b91-40df9654e606 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:53.177067 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7cc3afed-773d-4490-8b91-40df9654e606 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:53.177512 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7cc3afed-773d-4490-8b91-40df9654e606 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:53.177927 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7cc3afed-773d-4490-8b91-40df9654e606 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:53.352402 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-7cc3afed-773d-4490-8b91-40df9654e606 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf/ips" status: 200 len: 150 microversion: 2.1 time: 0.287125 Aug 18 14:56:53.352868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 467/729] 10.222.0.36 () {58 vars in 1248 bytes} [Thu Aug 18 14:56:53 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf/ips => generated 150 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:56:53.706194 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-eaa44e77-0f4b-4dc3-a906-9ffd17fe5706 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:53.706868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-eaa44e77-0f4b-4dc3-a906-9ffd17fe5706 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:53.713278 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-eaa44e77-0f4b-4dc3-a906-9ffd17fe5706 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:53.713758 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-eaa44e77-0f4b-4dc3-a906-9ffd17fe5706 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:53.714195 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-eaa44e77-0f4b-4dc3-a906-9ffd17fe5706 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:53.714889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-eaa44e77-0f4b-4dc3-a906-9ffd17fe5706 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:53.715395 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-eaa44e77-0f4b-4dc3-a906-9ffd17fe5706 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:53.715915 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-eaa44e77-0f4b-4dc3-a906-9ffd17fe5706 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:53.846441 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-eaa44e77-0f4b-4dc3-a906-9ffd17fe5706 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:53.855462 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-eaa44e77-0f4b-4dc3-a906-9ffd17fe5706 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1735 microversion: 2.1 time: 0.153000 Aug 18 14:56:53.856072 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 468/730] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:53 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:56:53.962340 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-684a39d8-475c-4075-a106-fd9b5a6a9f72 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:53.963041 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-684a39d8-475c-4075-a106-fd9b5a6a9f72 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:53.969201 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-684a39d8-475c-4075-a106-fd9b5a6a9f72 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:53.969758 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-684a39d8-475c-4075-a106-fd9b5a6a9f72 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:53.970329 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-684a39d8-475c-4075-a106-fd9b5a6a9f72 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:53.971096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-684a39d8-475c-4075-a106-fd9b5a6a9f72 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:53.971560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-684a39d8-475c-4075-a106-fd9b5a6a9f72 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:53.972040 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-684a39d8-475c-4075-a106-fd9b5a6a9f72 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:54.105718 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-684a39d8-475c-4075-a106-fd9b5a6a9f72 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:54.113537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-684a39d8-475c-4075-a106-fd9b5a6a9f72 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303" status: 200 len: 1363 microversion: 2.1 time: 0.155013 Aug 18 14:56:54.114110 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 469/731] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:53 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:56:54.681880 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b3e39b4d-cb56-46e8-86b1-d3ecc09089bf tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1a8e8bb-169e-4fe1-9732-b0cb983ebd86"}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:56:54.684314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b3e39b4d-cb56-46e8-86b1-d3ecc09089bf tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:54.690466 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b3e39b4d-cb56-46e8-86b1-d3ecc09089bf tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:54.690895 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b3e39b4d-cb56-46e8-86b1-d3ecc09089bf tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:54.691332 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b3e39b4d-cb56-46e8-86b1-d3ecc09089bf tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:54.692054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b3e39b4d-cb56-46e8-86b1-d3ecc09089bf tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:54.693003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b3e39b4d-cb56-46e8-86b1-d3ecc09089bf tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:54.693428 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b3e39b4d-cb56-46e8-86b1-d3ecc09089bf tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:54.695927 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:56:54.964938 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b3e39b4d-cb56-46e8-86b1-d3ecc09089bf tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "POST /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286772 Aug 18 14:56:54.965710 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 470/732] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Aug 18 14:56:54 2022] POST /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:56:54.971553 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-4d529081-0f02-4bee-9282-85adf54b511f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:54.972291 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-4d529081-0f02-4bee-9282-85adf54b511f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:54.978683 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4d529081-0f02-4bee-9282-85adf54b511f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:54.979174 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4d529081-0f02-4bee-9282-85adf54b511f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:54.980043 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4d529081-0f02-4bee-9282-85adf54b511f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:54.980344 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4d529081-0f02-4bee-9282-85adf54b511f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:54.980915 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4d529081-0f02-4bee-9282-85adf54b511f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:54.981217 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4d529081-0f02-4bee-9282-85adf54b511f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:55.119305 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-4d529081-0f02-4bee-9282-85adf54b511f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:55.127897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-4d529081-0f02-4bee-9282-85adf54b511f tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1735 microversion: 2.1 time: 0.161030 Aug 18 14:56:55.128452 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 471/733] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:54 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:56:55.135052 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b9441201-a632-4209-979f-bed0d6a863b4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:55.135749 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b9441201-a632-4209-979f-bed0d6a863b4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:55.143485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b9441201-a632-4209-979f-bed0d6a863b4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:55.143485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b9441201-a632-4209-979f-bed0d6a863b4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:55.143842 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b9441201-a632-4209-979f-bed0d6a863b4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:55.144324 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b9441201-a632-4209-979f-bed0d6a863b4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:55.144772 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b9441201-a632-4209-979f-bed0d6a863b4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:55.145191 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b9441201-a632-4209-979f-bed0d6a863b4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:55.275032 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b9441201-a632-4209-979f-bed0d6a863b4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:55.282675 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b9441201-a632-4209-979f-bed0d6a863b4 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303" status: 200 len: 1363 microversion: 2.1 time: 0.151485 Aug 18 14:56:55.283230 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 472/734] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:55 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:56:55.934841 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-3f2dea0f-743f-43a8-8ada-a804a35c91a4 req-04a6773d-7aa4-461f-ac6d-042c500fe6a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0587b3b6-bb0f-443b-8b28-0035ad738303", "name": "network-vif-plugged", "status": "completed", "tag": "873d5f42-d16f-439c-afa0-71e8f2a27384"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:56:55.945497 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-3f2dea0f-743f-43a8-8ada-a804a35c91a4 req-04a6773d-7aa4-461f-ac6d-042c500fe6a7 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:55.946047 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-3f2dea0f-743f-43a8-8ada-a804a35c91a4 req-04a6773d-7aa4-461f-ac6d-042c500fe6a7 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:55.946535 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-3f2dea0f-743f-43a8-8ada-a804a35c91a4 req-04a6773d-7aa4-461f-ac6d-042c500fe6a7 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:55.958299 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-3f2dea0f-743f-43a8-8ada-a804a35c91a4 req-04a6773d-7aa4-461f-ac6d-042c500fe6a7 service nova] Creating event network-vif-plugged:873d5f42-d16f-439c-afa0-71e8f2a27384 for instance 0587b3b6-bb0f-443b-8b28-0035ad738303 on hv-cinder-85220 Aug 18 14:56:55.962946 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-3f2dea0f-743f-43a8-8ada-a804a35c91a4 req-04a6773d-7aa4-461f-ac6d-042c500fe6a7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031954 Aug 18 14:56:55.963525 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 473/735] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:56:56.151168 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5b5d47cc-b892-4156-8e11-6908807e3f1a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:56.151917 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-5b5d47cc-b892-4156-8e11-6908807e3f1a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:56.158176 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5b5d47cc-b892-4156-8e11-6908807e3f1a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:56.158591 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5b5d47cc-b892-4156-8e11-6908807e3f1a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:56.159023 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5b5d47cc-b892-4156-8e11-6908807e3f1a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:56.159756 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5b5d47cc-b892-4156-8e11-6908807e3f1a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:56.160212 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5b5d47cc-b892-4156-8e11-6908807e3f1a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:56.160633 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5b5d47cc-b892-4156-8e11-6908807e3f1a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:56.322573 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-5b5d47cc-b892-4156-8e11-6908807e3f1a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:56.330793 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-5b5d47cc-b892-4156-8e11-6908807e3f1a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1735 microversion: 2.1 time: 0.184209 Aug 18 14:56:56.331349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 474/736] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:56 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:56:56.336899 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-390c178c-f1d7-49ed-83f2-9f6184333c66 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:56.337504 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-390c178c-f1d7-49ed-83f2-9f6184333c66 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:56.340245 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:56:56.344603 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-390c178c-f1d7-49ed-83f2-9f6184333c66 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:56.345088 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-390c178c-f1d7-49ed-83f2-9f6184333c66 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:56.345528 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-390c178c-f1d7-49ed-83f2-9f6184333c66 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:56.346221 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-390c178c-f1d7-49ed-83f2-9f6184333c66 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:56.346679 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-390c178c-f1d7-49ed-83f2-9f6184333c66 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:56.347107 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-390c178c-f1d7-49ed-83f2-9f6184333c66 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:56.479014 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-390c178c-f1d7-49ed-83f2-9f6184333c66 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:56.486531 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-390c178c-f1d7-49ed-83f2-9f6184333c66 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303" status: 200 len: 1363 microversion: 2.1 time: 0.154226 Aug 18 14:56:56.487081 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 475/737] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:56 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:56:57.354973 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-325f8cf4-cf11-4c1d-8ac8-3ded540a16be tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:57.355639 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-325f8cf4-cf11-4c1d-8ac8-3ded540a16be tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:57.357455 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=2 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:56:57.358212 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=12 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:56:57.364504 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-325f8cf4-cf11-4c1d-8ac8-3ded540a16be tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:57.365124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-325f8cf4-cf11-4c1d-8ac8-3ded540a16be tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:57.365557 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-325f8cf4-cf11-4c1d-8ac8-3ded540a16be tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:57.366250 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-325f8cf4-cf11-4c1d-8ac8-3ded540a16be tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:57.366723 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-325f8cf4-cf11-4c1d-8ac8-3ded540a16be tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:57.367143 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-325f8cf4-cf11-4c1d-8ac8-3ded540a16be tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:57.498553 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-325f8cf4-cf11-4c1d-8ac8-3ded540a16be tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:57.507819 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-325f8cf4-cf11-4c1d-8ac8-3ded540a16be tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1735 microversion: 2.1 time: 0.156655 Aug 18 14:56:57.508385 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 476/738] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:57 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:56:57.513187 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3ebf8640-fd85-4af5-9c09-7d1b0f5b4934 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:57.513786 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-3ebf8640-fd85-4af5-9c09-7d1b0f5b4934 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:57.519432 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3ebf8640-fd85-4af5-9c09-7d1b0f5b4934 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:57.519939 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3ebf8640-fd85-4af5-9c09-7d1b0f5b4934 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:57.520369 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3ebf8640-fd85-4af5-9c09-7d1b0f5b4934 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:57.521052 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3ebf8640-fd85-4af5-9c09-7d1b0f5b4934 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:57.521504 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3ebf8640-fd85-4af5-9c09-7d1b0f5b4934 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:57.521922 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3ebf8640-fd85-4af5-9c09-7d1b0f5b4934 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:57.651805 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-3ebf8640-fd85-4af5-9c09-7d1b0f5b4934 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:57.659820 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-3ebf8640-fd85-4af5-9c09-7d1b0f5b4934 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303" status: 200 len: 1363 microversion: 2.1 time: 0.150447 Aug 18 14:56:57.660356 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 477/739] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:57 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:56:58.529474 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d7b72373-2f8f-4d22-b8d1-cf32d50ac32d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:58.530116 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d7b72373-2f8f-4d22-b8d1-cf32d50ac32d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:58.537633 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d7b72373-2f8f-4d22-b8d1-cf32d50ac32d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:58.538165 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d7b72373-2f8f-4d22-b8d1-cf32d50ac32d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:58.538649 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d7b72373-2f8f-4d22-b8d1-cf32d50ac32d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:58.539330 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d7b72373-2f8f-4d22-b8d1-cf32d50ac32d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:58.539968 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d7b72373-2f8f-4d22-b8d1-cf32d50ac32d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:58.540443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d7b72373-2f8f-4d22-b8d1-cf32d50ac32d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:58.668729 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d7b72373-2f8f-4d22-b8d1-cf32d50ac32d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:58.677332 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d7b72373-2f8f-4d22-b8d1-cf32d50ac32d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1735 microversion: 2.1 time: 0.151663 Aug 18 14:56:58.677897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 478/740] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:58 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:56:58.688201 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-57d23312-bac2-4ace-996d-f85230530fbe tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:58.688850 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-57d23312-bac2-4ace-996d-f85230530fbe tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:58.695040 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57d23312-bac2-4ace-996d-f85230530fbe tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:58.695547 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57d23312-bac2-4ace-996d-f85230530fbe tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:58.696011 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57d23312-bac2-4ace-996d-f85230530fbe tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:58.696702 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57d23312-bac2-4ace-996d-f85230530fbe tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:58.697177 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57d23312-bac2-4ace-996d-f85230530fbe tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:58.697580 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57d23312-bac2-4ace-996d-f85230530fbe tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:58.826927 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-57d23312-bac2-4ace-996d-f85230530fbe tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:58.835134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-57d23312-bac2-4ace-996d-f85230530fbe tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303" status: 200 len: 1549 microversion: 2.1 time: 0.150815 Aug 18 14:56:58.835703 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 479/741] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:58 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:56:58.855612 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-4897781f-e1fe-4584-8dfd-1f9cb19854e7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:58.856134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-4897781f-e1fe-4584-8dfd-1f9cb19854e7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:58.861841 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4897781f-e1fe-4584-8dfd-1f9cb19854e7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:58.862317 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4897781f-e1fe-4584-8dfd-1f9cb19854e7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:58.862748 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4897781f-e1fe-4584-8dfd-1f9cb19854e7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:58.863431 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4897781f-e1fe-4584-8dfd-1f9cb19854e7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:58.863909 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4897781f-e1fe-4584-8dfd-1f9cb19854e7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:58.864359 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4897781f-e1fe-4584-8dfd-1f9cb19854e7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:58.941010 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-4897781f-e1fe-4584-8dfd-1f9cb19854e7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089040 Aug 18 14:56:58.941669 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 480/742] 10.222.0.36 () {58 vars in 1275 bytes} [Thu Aug 18 14:56:58 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:56:59.699605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3f11b174-0812-4065-9741-5242ce62a7b6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:56:59.700452 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-3f11b174-0812-4065-9741-5242ce62a7b6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:56:59.706327 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3f11b174-0812-4065-9741-5242ce62a7b6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:59.706816 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3f11b174-0812-4065-9741-5242ce62a7b6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:59.707245 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3f11b174-0812-4065-9741-5242ce62a7b6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:59.708024 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3f11b174-0812-4065-9741-5242ce62a7b6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:56:59.708475 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3f11b174-0812-4065-9741-5242ce62a7b6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:56:59.708896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3f11b174-0812-4065-9741-5242ce62a7b6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:56:59.840422 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-3f11b174-0812-4065-9741-5242ce62a7b6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:56:59.849372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-3f11b174-0812-4065-9741-5242ce62a7b6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1735 microversion: 2.1 time: 0.154172 Aug 18 14:56:59.849941 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 481/743] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:56:59 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:00.138546 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-3c815533-faad-480c-914a-c9560786515c req-5780b183-6624-4410-907a-b9348488a514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0587b3b6-bb0f-443b-8b28-0035ad738303", "tag": "873d5f42-d16f-439c-afa0-71e8f2a27384"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:57:00.148659 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-3c815533-faad-480c-914a-c9560786515c req-5780b183-6624-4410-907a-b9348488a514 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:00.149166 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-3c815533-faad-480c-914a-c9560786515c req-5780b183-6624-4410-907a-b9348488a514 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:00.149599 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-3c815533-faad-480c-914a-c9560786515c req-5780b183-6624-4410-907a-b9348488a514 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:00.160459 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-3c815533-faad-480c-914a-c9560786515c req-5780b183-6624-4410-907a-b9348488a514 service nova] Creating event network-changed:873d5f42-d16f-439c-afa0-71e8f2a27384 for instance 0587b3b6-bb0f-443b-8b28-0035ad738303 on hv-cinder-85220 Aug 18 14:57:00.165508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-3c815533-faad-480c-914a-c9560786515c req-5780b183-6624-4410-907a-b9348488a514 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086362 Aug 18 14:57:00.166952 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 482/744] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:57:00.871397 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-28c2f838-e3c2-4d2b-a62d-fe7ea9d01bbf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:00.872151 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-28c2f838-e3c2-4d2b-a62d-fe7ea9d01bbf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:00.882820 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-28c2f838-e3c2-4d2b-a62d-fe7ea9d01bbf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:00.883584 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-28c2f838-e3c2-4d2b-a62d-fe7ea9d01bbf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:00.884036 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-28c2f838-e3c2-4d2b-a62d-fe7ea9d01bbf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:00.884753 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-28c2f838-e3c2-4d2b-a62d-fe7ea9d01bbf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:00.885203 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-28c2f838-e3c2-4d2b-a62d-fe7ea9d01bbf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:00.885621 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-28c2f838-e3c2-4d2b-a62d-fe7ea9d01bbf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:01.027475 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-28c2f838-e3c2-4d2b-a62d-fe7ea9d01bbf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:01.036468 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-28c2f838-e3c2-4d2b-a62d-fe7ea9d01bbf tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1735 microversion: 2.1 time: 0.169737 Aug 18 14:57:01.037139 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 483/745] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:00 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:02.064290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-871be22a-4a6c-4cd7-accc-c7c75545aad2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:02.065442 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-871be22a-4a6c-4cd7-accc-c7c75545aad2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:02.078092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-871be22a-4a6c-4cd7-accc-c7c75545aad2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:02.078800 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-871be22a-4a6c-4cd7-accc-c7c75545aad2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:02.079398 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-871be22a-4a6c-4cd7-accc-c7c75545aad2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:02.080418 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-871be22a-4a6c-4cd7-accc-c7c75545aad2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:02.081140 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-871be22a-4a6c-4cd7-accc-c7c75545aad2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:02.081708 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-871be22a-4a6c-4cd7-accc-c7c75545aad2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:02.214651 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-871be22a-4a6c-4cd7-accc-c7c75545aad2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:02.222860 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-871be22a-4a6c-4cd7-accc-c7c75545aad2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1735 microversion: 2.1 time: 0.166074 Aug 18 14:57:02.223454 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 484/746] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:02 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:57:02.508452 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ce4b0fe3-ec87-4169-83c1-d7de2f615ec4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1a8e8bb-169e-4fe1-9732-b0cb983ebd86"}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:57:02.510938 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ce4b0fe3-ec87-4169-83c1-d7de2f615ec4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:02.517314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ce4b0fe3-ec87-4169-83c1-d7de2f615ec4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:02.517845 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ce4b0fe3-ec87-4169-83c1-d7de2f615ec4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:02.518281 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ce4b0fe3-ec87-4169-83c1-d7de2f615ec4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:02.518974 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ce4b0fe3-ec87-4169-83c1-d7de2f615ec4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:02.519427 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ce4b0fe3-ec87-4169-83c1-d7de2f615ec4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:02.519884 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ce4b0fe3-ec87-4169-83c1-d7de2f615ec4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:02.599762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-ce4b0fe3-ec87-4169-83c1-d7de2f615ec4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] HTTP exception thrown: Invalid volume: volume a1a8e8bb-169e-4fe1-9732-b0cb983ebd86 is already attached to instances: 0423b68b-575f-459e-a227-32d920e325cf Aug 18 14:57:02.601560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ce4b0fe3-ec87-4169-83c1-d7de2f615ec4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Request method failure captured: Aug 18 14:57:02.601560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: POST /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf/os-volume_attachments HTTP/1.1 Aug 18 14:57:02.601560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:57:02.601560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:57:02.601560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:57:02.601560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 74 Aug 18 14:57:02.601560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:57:02.601560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:57:02.601560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:57:02.601560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:57:02.601560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lH4oIml6txed07XrppfY0Z5jhCeqS9LCxxoulg2eAhfaJ8WphU-pzn12EaO7FXV8VEwOuzjKQEfCBldz9fUbgppMEKJd_VSbDb_aR-Ce__ScpKEICpMOfadH5ZH-EfODQJGUEz0cyaOMRlNct6asFRrMu0s30r91ZjclG___yh0IIw Aug 18 14:57:02.601560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:57:02.601560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:57:02.601560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:57:02.601560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:57:02.601560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:57:02.601560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:57:02.601560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:57:02.601560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:57:02.601560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:57:02.601560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:57:02.604461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_55c9fe0cbbfa47bca81668c039afc092", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:57:02.604461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:57:02.604461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:57:02.604461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:57:02.604461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:57:02.604461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:57:02.604461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:57:02.604461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 36dbc938bcd741f2a2b2013b6aa6f008 Aug 18 14:57:02.604461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:57:02.604461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Aug 18 14:57:02.604461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {"volumeAttachment": {"volumeId": "a1a8e8bb-169e-4fe1-9732-b0cb983ebd86"}} Aug 18 14:57:02.604461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:57:02.605349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Invalid volume: volume a1a8e8bb-169e-4fe1-9732-b0cb983ebd86 is already attached to instances: 0423b68b-575f-459e-a227-32d920e325cf Aug 18 14:57:02.605349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'server_id': '0423b68b-575f-459e-a227-32d920e325cf', 'body': {'volumeAttachment': {'volumeId': 'a1a8e8bb-169e-4fe1-9732-b0cb983ebd86'}}} Aug 18 14:57:02.605349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:57:02.605349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:57:02.605349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 18 14:57:02.605349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 18 14:57:02.605349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 14:57:02.605349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 14:57:02.605349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 18 14:57:02.605349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 14:57:02.605349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5122, in attach_volume Aug 18 14:57:02.605349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 18 14:57:02.605349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4962, in _check_volume_already_attached Aug 18 14:57:02.605349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 18 14:57:02.605349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a1a8e8bb-169e-4fe1-9732-b0cb983ebd86 is already attached to instances: 0423b68b-575f-459e-a227-32d920e325cf Aug 18 14:57:02.605349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:57:02.605349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:57:02.605349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:57:02.605349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:57:02.606777 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:57:02.606777 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:57:02.606777 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:57:02.606777 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:57:02.606777 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:57:02.606777 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:57:02.606777 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 14:57:02.606777 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 14:57:02.606777 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 14:57:02.606777 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 14:57:02.606777 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 14:57:02.606777 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 14:57:02.606777 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 18 14:57:02.606777 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 18 14:57:02.606777 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a1a8e8bb-169e-4fe1-9732-b0cb983ebd86 is already attached to instances: 0423b68b-575f-459e-a227-32d920e325cf Aug 18 14:57:02.606777 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:57:02.606777 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:57:02.606777 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:57:02.606777 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:57:02.606777 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:57:02.608210 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:57:02.608210 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:57:02.608210 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:57:02.608210 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a1a8e8bb-169e-4fe1-9732-b0cb983ebd86 is already attached to instances: 0423b68b-575f-459e-a227-32d920e325cf Aug 18 14:57:02.608210 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:57:02.608210 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ce4b0fe3-ec87-4169-83c1-d7de2f615ec4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Returning 400 to user: Invalid volume: volume a1a8e8bb-169e-4fe1-9732-b0cb983ebd86 is already attached to instances: 0423b68b-575f-459e-a227-32d920e325cf {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:57:02.608210 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-ce4b0fe3-ec87-4169-83c1-d7de2f615ec4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "POST /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099176 Aug 18 14:57:02.608210 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 485/747] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Aug 18 14:57:02 2022] POST /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 18 14:57:02.669528 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-466dfdef-0e97-475c-b0be-6ec207c26b77 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:02.670007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-466dfdef-0e97-475c-b0be-6ec207c26b77 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:02.676147 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-466dfdef-0e97-475c-b0be-6ec207c26b77 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:02.677175 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-466dfdef-0e97-475c-b0be-6ec207c26b77 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:02.677613 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-466dfdef-0e97-475c-b0be-6ec207c26b77 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:02.678298 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-466dfdef-0e97-475c-b0be-6ec207c26b77 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:02.678751 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-466dfdef-0e97-475c-b0be-6ec207c26b77 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:02.679174 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-466dfdef-0e97-475c-b0be-6ec207c26b77 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:02.758916 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.objects.instance [None req-466dfdef-0e97-475c-b0be-6ec207c26b77 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lazy-loading 'services' on Instance uuid 0423b68b-575f-459e-a227-32d920e325cf {{(pid=132268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:57:02.762752 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:57:02.834728 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-466dfdef-0e97-475c-b0be-6ec207c26b77 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf/os-volume_attachments/a1a8e8bb-169e-4fe1-9732-b0cb983ebd86" status: 202 len: 0 microversion: 2.1 time: 0.168920 Aug 18 14:57:02.835641 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 486/748] 10.222.0.36 () {58 vars in 1416 bytes} [Thu Aug 18 14:57:02 2022] DELETE /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf/os-volume_attachments/a1a8e8bb-169e-4fe1-9732-b0cb983ebd86 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 14:57:02.845582 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d8ca3aaa-bdca-4b93-9a28-40c377b000d7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:02.847967 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d8ca3aaa-bdca-4b93-9a28-40c377b000d7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:02.854963 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d8ca3aaa-bdca-4b93-9a28-40c377b000d7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:02.855444 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d8ca3aaa-bdca-4b93-9a28-40c377b000d7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:02.855953 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d8ca3aaa-bdca-4b93-9a28-40c377b000d7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:02.856644 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d8ca3aaa-bdca-4b93-9a28-40c377b000d7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:02.857094 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d8ca3aaa-bdca-4b93-9a28-40c377b000d7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:02.857514 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d8ca3aaa-bdca-4b93-9a28-40c377b000d7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:02.887560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d8ca3aaa-bdca-4b93-9a28-40c377b000d7 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047264 Aug 18 14:57:02.888146 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 487/749] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Aug 18 14:57:02 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:57:03.243151 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-002fde77-dfc8-4add-9972-5c81e2875cfe tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:03.243788 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-002fde77-dfc8-4add-9972-5c81e2875cfe tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:03.250155 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-002fde77-dfc8-4add-9972-5c81e2875cfe tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:03.250638 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-002fde77-dfc8-4add-9972-5c81e2875cfe tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:03.251070 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-002fde77-dfc8-4add-9972-5c81e2875cfe tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:03.251789 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-002fde77-dfc8-4add-9972-5c81e2875cfe tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:03.252245 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-002fde77-dfc8-4add-9972-5c81e2875cfe tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:03.252668 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-002fde77-dfc8-4add-9972-5c81e2875cfe tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:03.389889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-002fde77-dfc8-4add-9972-5c81e2875cfe tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:03.398998 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-002fde77-dfc8-4add-9972-5c81e2875cfe tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1715 microversion: 2.1 time: 0.159741 Aug 18 14:57:03.399564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 488/750] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:03 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1715 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:03.512672 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5f518958-3a86-4874-b4fc-6e2ddba2be44 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:03.513171 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-5f518958-3a86-4874-b4fc-6e2ddba2be44 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:03.519144 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5f518958-3a86-4874-b4fc-6e2ddba2be44 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:03.519628 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5f518958-3a86-4874-b4fc-6e2ddba2be44 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:03.520200 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5f518958-3a86-4874-b4fc-6e2ddba2be44 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:03.521404 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5f518958-3a86-4874-b4fc-6e2ddba2be44 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:03.521892 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5f518958-3a86-4874-b4fc-6e2ddba2be44 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:03.522319 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5f518958-3a86-4874-b4fc-6e2ddba2be44 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:03.600680 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-5f518958-3a86-4874-b4fc-6e2ddba2be44 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] HTTP exception thrown: Cannot 'detach_volume' instance d9163961-387b-4e9b-94a8-9647dde7c208 while it is in vm_state rescued Aug 18 14:57:03.602304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5f518958-3a86-4874-b4fc-6e2ddba2be44 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Request method failure captured: Aug 18 14:57:03.602304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: DELETE /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/os-volume_attachments/dc24f99d-2752-4fc1-afee-621294774608 HTTP/1.1 Aug 18 14:57:03.602304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:57:03.602304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:57:03.602304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:57:03.602304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:57:03.602304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:57:03.602304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:57:03.602304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:57:03.602304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:57:03.602304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lJQwK2c115bNCfI9_4SFNLkllfgSZr5El1eNqitr3OQtjGAEW-PK-gbdLreyn40k786Z-SK2YhgyrUV5WJGnNRJIEHwtBu_7UfQYOE30KQE3ki2AOXsYaAaQyEq_0p9RnrNtYTZZ5VHW9FG03qMbGgeDDQs-wc6W0Yv5SdnYB7CjZs Aug 18 14:57:03.602304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:57:03.602304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:57:03.602304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:57:03.602304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:57:03.602304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:57:03.602304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:57:03.602304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: acc902aa109c4d7291c0bab62f80048e Aug 18 14:57:03.602304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1560225051 Aug 18 14:57:03.602304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:57:03.602304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:57:03.603873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/acc902aa109c4d7291c0bab62f80048e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/acc902aa109c4d7291c0bab62f80048e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_acc902aa109c4d7291c0bab62f80048e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/acc902aa109c4d7291c0bab62f80048e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:57:03.603873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1560225051 Aug 18 14:57:03.603873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: acc902aa109c4d7291c0bab62f80048e Aug 18 14:57:03.603873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1560225051 Aug 18 14:57:03.603873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-ServerRescueNegativeTestJSON-1560225051-project Aug 18 14:57:03.603873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:57:03.603873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:57:03.603873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 26eaa7f102bd41028983458ae48ff992 Aug 18 14:57:03.603873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1560225051-project Aug 18 14:57:03.603873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:57:03.603873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Cannot 'detach_volume' instance d9163961-387b-4e9b-94a8-9647dde7c208 while it is in vm_state rescued Aug 18 14:57:03.604661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'server_id': 'd9163961-387b-4e9b-94a8-9647dde7c208', 'id': 'dc24f99d-2752-4fc1-afee-621294774608'} Aug 18 14:57:03.604661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:57:03.604661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:57:03.604661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 18 14:57:03.604661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 18 14:57:03.604661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 14:57:03.604661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 14:57:03.604661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 14:57:03.604661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 14:57:03.604661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d9163961-387b-4e9b-94a8-9647dde7c208 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 18 14:57:03.604661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:57:03.604661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:57:03.604661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:57:03.604661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:57:03.604661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:57:03.604661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:57:03.604661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:57:03.604661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:57:03.604661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:57:03.604661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:57:03.606182 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 18 14:57:03.606182 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 14:57:03.606182 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 14:57:03.606182 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 14:57:03.606182 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d9163961-387b-4e9b-94a8-9647dde7c208 while it is in vm_state rescued Aug 18 14:57:03.606182 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:57:03.606182 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:57:03.606182 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:57:03.606182 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:57:03.606182 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:57:03.606182 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:57:03.606182 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:57:03.606182 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:57:03.606182 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d9163961-387b-4e9b-94a8-9647dde7c208 while it is in vm_state rescued Aug 18 14:57:03.606182 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:57:03.606182 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5f518958-3a86-4874-b4fc-6e2ddba2be44 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Returning 409 to user: Cannot 'detach_volume' instance d9163961-387b-4e9b-94a8-9647dde7c208 while it is in vm_state rescued {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:57:03.607335 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-5f518958-3a86-4874-b4fc-6e2ddba2be44 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/os-volume_attachments/dc24f99d-2752-4fc1-afee-621294774608" status: 409 len: 152 microversion: 2.1 time: 0.095310 Aug 18 14:57:03.607335 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 489/751] 10.222.0.36 () {58 vars in 1416 bytes} [Thu Aug 18 14:57:03 2022] DELETE /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/os-volume_attachments/dc24f99d-2752-4fc1-afee-621294774608 => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 18 14:57:03.612302 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-6ca34ed9-79e3-4766-8c8b-df46a4657fd9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:57:03.612826 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-6ca34ed9-79e3-4766-8c8b-df46a4657fd9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:03.619173 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6ca34ed9-79e3-4766-8c8b-df46a4657fd9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:03.619647 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6ca34ed9-79e3-4766-8c8b-df46a4657fd9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:03.620119 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6ca34ed9-79e3-4766-8c8b-df46a4657fd9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:03.620797 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6ca34ed9-79e3-4766-8c8b-df46a4657fd9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:03.621273 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6ca34ed9-79e3-4766-8c8b-df46a4657fd9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:03.621685 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6ca34ed9-79e3-4766-8c8b-df46a4657fd9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:03.692201 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-6ca34ed9-79e3-4766-8c8b-df46a4657fd9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "POST /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/action" status: 202 len: 0 microversion: 2.1 time: 0.083234 Aug 18 14:57:03.692822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 490/752] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Aug 18 14:57:03 2022] POST /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:57:03.701099 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-dd33ac60-210a-4375-8349-89638f0346ca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:03.701800 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-dd33ac60-210a-4375-8349-89638f0346ca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:03.708311 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dd33ac60-210a-4375-8349-89638f0346ca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:03.708794 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dd33ac60-210a-4375-8349-89638f0346ca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:03.709232 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dd33ac60-210a-4375-8349-89638f0346ca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:03.709925 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dd33ac60-210a-4375-8349-89638f0346ca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:03.710380 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dd33ac60-210a-4375-8349-89638f0346ca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:03.710806 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dd33ac60-210a-4375-8349-89638f0346ca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:03.837927 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-dd33ac60-210a-4375-8349-89638f0346ca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:03.846257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-dd33ac60-210a-4375-8349-89638f0346ca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1723 microversion: 2.1 time: 0.149189 Aug 18 14:57:03.846818 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 491/753] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:03 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:03.901558 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5353d589-e3bc-470f-88e7-1543e39c91a2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:03.904230 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-5353d589-e3bc-470f-88e7-1543e39c91a2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:03.911744 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5353d589-e3bc-470f-88e7-1543e39c91a2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:03.912409 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5353d589-e3bc-470f-88e7-1543e39c91a2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:03.913033 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5353d589-e3bc-470f-88e7-1543e39c91a2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:03.913752 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5353d589-e3bc-470f-88e7-1543e39c91a2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:03.914236 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5353d589-e3bc-470f-88e7-1543e39c91a2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:03.914657 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5353d589-e3bc-470f-88e7-1543e39c91a2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:03.946791 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-5353d589-e3bc-470f-88e7-1543e39c91a2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049194 Aug 18 14:57:03.947341 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 492/754] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Aug 18 14:57:03 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:57:04.868425 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a6e9ff8a-566d-4bbc-9632-b662bcbf24b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:04.869065 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a6e9ff8a-566d-4bbc-9632-b662bcbf24b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:04.875530 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a6e9ff8a-566d-4bbc-9632-b662bcbf24b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:04.876052 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a6e9ff8a-566d-4bbc-9632-b662bcbf24b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:04.876484 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a6e9ff8a-566d-4bbc-9632-b662bcbf24b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:04.877179 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a6e9ff8a-566d-4bbc-9632-b662bcbf24b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:04.877748 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a6e9ff8a-566d-4bbc-9632-b662bcbf24b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:04.878046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a6e9ff8a-566d-4bbc-9632-b662bcbf24b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:05.010626 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a6e9ff8a-566d-4bbc-9632-b662bcbf24b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:05.019026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a6e9ff8a-566d-4bbc-9632-b662bcbf24b8 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1723 microversion: 2.1 time: 0.155269 Aug 18 14:57:05.019573 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 493/755] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:04 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:05.025269 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ab8a8d92-d8f1-47a1-a82f-b338e562cef5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:05.026185 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ab8a8d92-d8f1-47a1-a82f-b338e562cef5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:05.031975 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ab8a8d92-d8f1-47a1-a82f-b338e562cef5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:05.032460 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ab8a8d92-d8f1-47a1-a82f-b338e562cef5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:05.032889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ab8a8d92-d8f1-47a1-a82f-b338e562cef5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:05.033582 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ab8a8d92-d8f1-47a1-a82f-b338e562cef5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:05.034034 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ab8a8d92-d8f1-47a1-a82f-b338e562cef5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:05.034454 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ab8a8d92-d8f1-47a1-a82f-b338e562cef5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:05.064384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-ab8a8d92-d8f1-47a1-a82f-b338e562cef5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043736 Aug 18 14:57:05.065036 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 494/756] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Aug 18 14:57:05 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 14:57:05.127096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-973bf0f2-23ef-48d0-9688-843240b6f6b2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:05.127535 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-973bf0f2-23ef-48d0-9688-843240b6f6b2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:05.133575 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-973bf0f2-23ef-48d0-9688-843240b6f6b2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:05.134058 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-973bf0f2-23ef-48d0-9688-843240b6f6b2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:05.134494 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-973bf0f2-23ef-48d0-9688-843240b6f6b2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:05.135206 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-973bf0f2-23ef-48d0-9688-843240b6f6b2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:05.135658 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-973bf0f2-23ef-48d0-9688-843240b6f6b2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:05.136103 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-973bf0f2-23ef-48d0-9688-843240b6f6b2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:05.160508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-973bf0f2-23ef-48d0-9688-843240b6f6b2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Going to try to terminate instance {{(pid=132268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:57:05.237052 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-973bf0f2-23ef-48d0-9688-843240b6f6b2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf" status: 204 len: 0 microversion: 2.1 time: 0.113723 Aug 18 14:57:05.237624 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 495/757] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 14:57:05 2022] DELETE /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 14:57:05.246342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-4d842fde-5914-4df1-be6b-a5acbee35c8e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:05.247035 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-4d842fde-5914-4df1-be6b-a5acbee35c8e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:05.252526 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4d842fde-5914-4df1-be6b-a5acbee35c8e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:05.253006 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4d842fde-5914-4df1-be6b-a5acbee35c8e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:05.253472 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4d842fde-5914-4df1-be6b-a5acbee35c8e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:05.254156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4d842fde-5914-4df1-be6b-a5acbee35c8e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:05.254610 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4d842fde-5914-4df1-be6b-a5acbee35c8e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:05.255029 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4d842fde-5914-4df1-be6b-a5acbee35c8e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:05.382469 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-4d842fde-5914-4df1-be6b-a5acbee35c8e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:05.390617 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-4d842fde-5914-4df1-be6b-a5acbee35c8e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf" status: 200 len: 1682 microversion: 2.1 time: 0.148085 Aug 18 14:57:05.391220 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 496/758] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:05 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:06.040911 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-cc7cbba4-022d-47c4-a537-afb5f4914f74 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:06.041541 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-cc7cbba4-022d-47c4-a537-afb5f4914f74 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:06.048123 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cc7cbba4-022d-47c4-a537-afb5f4914f74 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:06.048609 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cc7cbba4-022d-47c4-a537-afb5f4914f74 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:06.049042 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cc7cbba4-022d-47c4-a537-afb5f4914f74 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:06.049729 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cc7cbba4-022d-47c4-a537-afb5f4914f74 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:06.050294 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cc7cbba4-022d-47c4-a537-afb5f4914f74 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:06.050705 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cc7cbba4-022d-47c4-a537-afb5f4914f74 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:06.179459 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-cc7cbba4-022d-47c4-a537-afb5f4914f74 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:06.187923 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-cc7cbba4-022d-47c4-a537-afb5f4914f74 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1723 microversion: 2.1 time: 0.150787 Aug 18 14:57:06.188492 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 497/759] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:06 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:06.414035 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5548749b-4405-43a8-80c1-98d08a49e3e9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:06.414642 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-5548749b-4405-43a8-80c1-98d08a49e3e9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:06.420753 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5548749b-4405-43a8-80c1-98d08a49e3e9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:06.421263 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5548749b-4405-43a8-80c1-98d08a49e3e9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:06.421600 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5548749b-4405-43a8-80c1-98d08a49e3e9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:06.422273 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5548749b-4405-43a8-80c1-98d08a49e3e9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:06.422719 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5548749b-4405-43a8-80c1-98d08a49e3e9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:06.423132 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5548749b-4405-43a8-80c1-98d08a49e3e9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:06.555872 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-5548749b-4405-43a8-80c1-98d08a49e3e9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:06.563658 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-5548749b-4405-43a8-80c1-98d08a49e3e9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf" status: 200 len: 1682 microversion: 2.1 time: 0.154080 Aug 18 14:57:06.564234 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 498/760] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:06 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:07.209683 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f3525e74-191b-45d0-8c7c-6f3ef0d82b98 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:07.210293 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f3525e74-191b-45d0-8c7c-6f3ef0d82b98 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:07.216770 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f3525e74-191b-45d0-8c7c-6f3ef0d82b98 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:07.217277 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f3525e74-191b-45d0-8c7c-6f3ef0d82b98 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:07.217730 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f3525e74-191b-45d0-8c7c-6f3ef0d82b98 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:07.218418 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f3525e74-191b-45d0-8c7c-6f3ef0d82b98 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:07.218873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f3525e74-191b-45d0-8c7c-6f3ef0d82b98 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:07.219297 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f3525e74-191b-45d0-8c7c-6f3ef0d82b98 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:07.348183 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f3525e74-191b-45d0-8c7c-6f3ef0d82b98 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:07.356364 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f3525e74-191b-45d0-8c7c-6f3ef0d82b98 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1723 microversion: 2.1 time: 0.150643 Aug 18 14:57:07.356916 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 499/761] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:07 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:07.589281 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d2a6b512-e8d2-49af-8d51-4c8701fc3cc8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:07.589973 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d2a6b512-e8d2-49af-8d51-4c8701fc3cc8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:07.596233 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d2a6b512-e8d2-49af-8d51-4c8701fc3cc8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:07.596781 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d2a6b512-e8d2-49af-8d51-4c8701fc3cc8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:07.597180 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d2a6b512-e8d2-49af-8d51-4c8701fc3cc8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:07.597922 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d2a6b512-e8d2-49af-8d51-4c8701fc3cc8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:07.598415 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d2a6b512-e8d2-49af-8d51-4c8701fc3cc8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:07.598893 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d2a6b512-e8d2-49af-8d51-4c8701fc3cc8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:07.614172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:57:07.733964 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d2a6b512-e8d2-49af-8d51-4c8701fc3cc8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:07.742427 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d2a6b512-e8d2-49af-8d51-4c8701fc3cc8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf" status: 200 len: 1682 microversion: 2.1 time: 0.157104 Aug 18 14:57:07.743130 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 500/762] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:07 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:08.195719 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-da24f5db-1240-48c1-a466-3153b8c00869 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:08.196230 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-da24f5db-1240-48c1-a466-3153b8c00869 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:08.202229 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-da24f5db-1240-48c1-a466-3153b8c00869 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:08.202710 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-da24f5db-1240-48c1-a466-3153b8c00869 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:08.203145 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-da24f5db-1240-48c1-a466-3153b8c00869 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:08.203872 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-da24f5db-1240-48c1-a466-3153b8c00869 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:08.204331 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-da24f5db-1240-48c1-a466-3153b8c00869 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:08.204753 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-da24f5db-1240-48c1-a466-3153b8c00869 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:08.229833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-da24f5db-1240-48c1-a466-3153b8c00869 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Going to try to terminate instance {{(pid=132268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:57:08.304174 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-da24f5db-1240-48c1-a466-3153b8c00869 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "DELETE /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 204 len: 0 microversion: 2.1 time: 0.112691 Aug 18 14:57:08.304741 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 501/763] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 14:57:08 2022] DELETE /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 14:57:08.313167 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5278f4d8-88dc-4f55-9e2a-f55d3176c477 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:08.313866 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-5278f4d8-88dc-4f55-9e2a-f55d3176c477 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:08.320053 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5278f4d8-88dc-4f55-9e2a-f55d3176c477 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:08.320540 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5278f4d8-88dc-4f55-9e2a-f55d3176c477 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:08.320971 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5278f4d8-88dc-4f55-9e2a-f55d3176c477 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:08.321656 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5278f4d8-88dc-4f55-9e2a-f55d3176c477 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:08.322111 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5278f4d8-88dc-4f55-9e2a-f55d3176c477 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:08.322534 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5278f4d8-88dc-4f55-9e2a-f55d3176c477 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:08.454018 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-5278f4d8-88dc-4f55-9e2a-f55d3176c477 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:08.461973 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-5278f4d8-88dc-4f55-9e2a-f55d3176c477 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 200 len: 1577 microversion: 2.1 time: 0.152789 Aug 18 14:57:08.462533 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 502/764] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:08 2022] GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:57:08.467088 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-9313bb91-bc08-4c61-9d51-28d131913ebd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:08.467710 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-9313bb91-bc08-4c61-9d51-28d131913ebd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:08.474023 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9313bb91-bc08-4c61-9d51-28d131913ebd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:08.474607 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9313bb91-bc08-4c61-9d51-28d131913ebd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:08.475335 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9313bb91-bc08-4c61-9d51-28d131913ebd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:08.476332 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9313bb91-bc08-4c61-9d51-28d131913ebd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:08.476931 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9313bb91-bc08-4c61-9d51-28d131913ebd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:08.477505 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9313bb91-bc08-4c61-9d51-28d131913ebd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:08.609386 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-9313bb91-bc08-4c61-9d51-28d131913ebd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:08.618307 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-9313bb91-bc08-4c61-9d51-28d131913ebd tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1729 microversion: 2.1 time: 0.154828 Aug 18 14:57:08.618901 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 503/765] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:08 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:57:08.639311 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3802915e-fd43-4d2e-923d-b006ff6d1797 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:08.639832 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-3802915e-fd43-4d2e-923d-b006ff6d1797 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:08.645810 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3802915e-fd43-4d2e-923d-b006ff6d1797 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:08.646288 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3802915e-fd43-4d2e-923d-b006ff6d1797 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:08.646719 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3802915e-fd43-4d2e-923d-b006ff6d1797 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:08.648059 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3802915e-fd43-4d2e-923d-b006ff6d1797 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:08.648619 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3802915e-fd43-4d2e-923d-b006ff6d1797 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:08.649117 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3802915e-fd43-4d2e-923d-b006ff6d1797 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:08.730471 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-3802915e-fd43-4d2e-923d-b006ff6d1797 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095079 Aug 18 14:57:08.731099 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 504/766] 10.222.0.36 () {58 vars in 1275 bytes} [Thu Aug 18 14:57:08 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:57:08.764400 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-849a3c21-8933-497b-ba65-819816e3b72a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:08.765016 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-849a3c21-8933-497b-ba65-819816e3b72a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:08.771093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-849a3c21-8933-497b-ba65-819816e3b72a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:08.771581 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-849a3c21-8933-497b-ba65-819816e3b72a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:08.772052 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-849a3c21-8933-497b-ba65-819816e3b72a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:08.772758 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-849a3c21-8933-497b-ba65-819816e3b72a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:08.773217 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-849a3c21-8933-497b-ba65-819816e3b72a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:08.773647 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-849a3c21-8933-497b-ba65-819816e3b72a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:09.034600 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-849a3c21-8933-497b-ba65-819816e3b72a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:09.042868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-849a3c21-8933-497b-ba65-819816e3b72a tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf" status: 200 len: 1682 microversion: 2.1 time: 0.282475 Aug 18 14:57:09.043435 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 505/767] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:08 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf => generated 1682 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:09.485010 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-312b9ab0-4907-46a4-8a24-6197f7f385b5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:09.485686 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-312b9ab0-4907-46a4-8a24-6197f7f385b5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:09.492651 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-312b9ab0-4907-46a4-8a24-6197f7f385b5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:09.493134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-312b9ab0-4907-46a4-8a24-6197f7f385b5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:09.493569 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-312b9ab0-4907-46a4-8a24-6197f7f385b5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:09.494257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-312b9ab0-4907-46a4-8a24-6197f7f385b5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:09.494705 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-312b9ab0-4907-46a4-8a24-6197f7f385b5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:09.496407 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-312b9ab0-4907-46a4-8a24-6197f7f385b5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:09.720807 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-312b9ab0-4907-46a4-8a24-6197f7f385b5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:09.728574 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-312b9ab0-4907-46a4-8a24-6197f7f385b5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 200 len: 1577 microversion: 2.1 time: 0.247487 Aug 18 14:57:09.729148 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 506/768] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:09 2022] GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 1577 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:57:10.055163 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-94ba39f6-1fe1-4a53-ba12-4ce327164673 req-b4b7006b-1f5a-4ee1-8a7a-9f2c360aedb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9163961-387b-4e9b-94a8-9647dde7c208", "tag": "e57de99a-4074-41f9-9a26-248196b630ba"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:57:10.066682 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-94ba39f6-1fe1-4a53-ba12-4ce327164673 req-b4b7006b-1f5a-4ee1-8a7a-9f2c360aedb7 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:10.067163 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-94ba39f6-1fe1-4a53-ba12-4ce327164673 req-b4b7006b-1f5a-4ee1-8a7a-9f2c360aedb7 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:10.067634 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-94ba39f6-1fe1-4a53-ba12-4ce327164673 req-b4b7006b-1f5a-4ee1-8a7a-9f2c360aedb7 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:10.079019 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-94ba39f6-1fe1-4a53-ba12-4ce327164673 req-b4b7006b-1f5a-4ee1-8a7a-9f2c360aedb7 service nova] Creating event network-changed:e57de99a-4074-41f9-9a26-248196b630ba for instance d9163961-387b-4e9b-94a8-9647dde7c208 on hv-cinder-85220 Aug 18 14:57:10.084714 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-94ba39f6-1fe1-4a53-ba12-4ce327164673 req-b4b7006b-1f5a-4ee1-8a7a-9f2c360aedb7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033707 Aug 18 14:57:10.085490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 507/769] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:57:10.090851 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e12bfba2-e26f-4713-9598-7b9a564311d3 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:10.091554 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e12bfba2-e26f-4713-9598-7b9a564311d3 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:10.098110 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e12bfba2-e26f-4713-9598-7b9a564311d3 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:10.099170 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e12bfba2-e26f-4713-9598-7b9a564311d3 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:10.099631 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e12bfba2-e26f-4713-9598-7b9a564311d3 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:10.100433 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e12bfba2-e26f-4713-9598-7b9a564311d3 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:10.100885 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e12bfba2-e26f-4713-9598-7b9a564311d3 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:10.101305 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e12bfba2-e26f-4713-9598-7b9a564311d3 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:10.315718 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e12bfba2-e26f-4713-9598-7b9a564311d3 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:10.323949 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e12bfba2-e26f-4713-9598-7b9a564311d3 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf" status: 200 len: 1682 microversion: 2.1 time: 0.236823 Aug 18 14:57:10.324929 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 508/770] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:10 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf => generated 1682 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:57:10.751504 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a5ff9939-f75d-46b3-a5c8-0843b6ce7065 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:10.753420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a5ff9939-f75d-46b3-a5c8-0843b6ce7065 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:10.764391 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a5ff9939-f75d-46b3-a5c8-0843b6ce7065 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:10.765424 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a5ff9939-f75d-46b3-a5c8-0843b6ce7065 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:10.766661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a5ff9939-f75d-46b3-a5c8-0843b6ce7065 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:10.767590 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a5ff9939-f75d-46b3-a5c8-0843b6ce7065 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:10.768786 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a5ff9939-f75d-46b3-a5c8-0843b6ce7065 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:10.769397 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a5ff9939-f75d-46b3-a5c8-0843b6ce7065 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:11.095644 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a5ff9939-f75d-46b3-a5c8-0843b6ce7065 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:11.105234 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a5ff9939-f75d-46b3-a5c8-0843b6ce7065 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 200 len: 1577 microversion: 2.1 time: 0.358943 Aug 18 14:57:11.105809 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 509/771] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:10 2022] GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 1577 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:57:11.345668 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b3729f58-627f-4399-ba4d-4a3491666aa2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:11.346307 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b3729f58-627f-4399-ba4d-4a3491666aa2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:11.352620 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b3729f58-627f-4399-ba4d-4a3491666aa2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:11.353175 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b3729f58-627f-4399-ba4d-4a3491666aa2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:11.353676 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b3729f58-627f-4399-ba4d-4a3491666aa2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:11.354373 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b3729f58-627f-4399-ba4d-4a3491666aa2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:11.354817 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b3729f58-627f-4399-ba4d-4a3491666aa2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:11.355268 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b3729f58-627f-4399-ba4d-4a3491666aa2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:11.467769 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b3729f58-627f-4399-ba4d-4a3491666aa2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:11.479534 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b3729f58-627f-4399-ba4d-4a3491666aa2 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf" status: 200 len: 1615 microversion: 2.1 time: 0.137465 Aug 18 14:57:11.480666 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 510/772] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:11 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf => generated 1615 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:12.111655 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-9103e11a-2899-4e4b-896d-18be9f3d06da req-888708de-66a4-4a4c-998a-c245892c9d75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9163961-387b-4e9b-94a8-9647dde7c208", "tag": "e57de99a-4074-41f9-9a26-248196b630ba"}, {"server_uuid": "0423b68b-575f-459e-a227-32d920e325cf", "name": "network-vif-deleted", "tag": "233ce2fc-4700-4dcf-9eae-52ea3d8932d3"}, {"server_uuid": "80e04f79-c52c-4c8e-be85-d3beb6146729", "name": "network-vif-deleted", "tag": "f09381f7-1a30-4400-be85-bedf9e4caa60"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:57:12.137597 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-9103e11a-2899-4e4b-896d-18be9f3d06da req-888708de-66a4-4a4c-998a-c245892c9d75 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:12.139591 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-9103e11a-2899-4e4b-896d-18be9f3d06da req-888708de-66a4-4a4c-998a-c245892c9d75 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:12.140770 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-9103e11a-2899-4e4b-896d-18be9f3d06da req-888708de-66a4-4a4c-998a-c245892c9d75 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:12.184882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-9103e11a-2899-4e4b-896d-18be9f3d06da req-888708de-66a4-4a4c-998a-c245892c9d75 service nova] Creating event network-changed:e57de99a-4074-41f9-9a26-248196b630ba for instance d9163961-387b-4e9b-94a8-9647dde7c208 on hv-cinder-85220 Aug 18 14:57:12.185494 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-9103e11a-2899-4e4b-896d-18be9f3d06da req-888708de-66a4-4a4c-998a-c245892c9d75 service nova] Creating event network-vif-deleted:233ce2fc-4700-4dcf-9eae-52ea3d8932d3 for instance 0423b68b-575f-459e-a227-32d920e325cf on hv-cinder-85220 Aug 18 14:57:12.186216 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-9103e11a-2899-4e4b-896d-18be9f3d06da req-888708de-66a4-4a4c-998a-c245892c9d75 service nova] Creating event network-vif-deleted:f09381f7-1a30-4400-be85-bedf9e4caa60 for instance 80e04f79-c52c-4c8e-be85-d3beb6146729 on hv-cinder-85220 Aug 18 14:57:12.196953 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-9103e11a-2899-4e4b-896d-18be9f3d06da req-888708de-66a4-4a4c-998a-c245892c9d75 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.089543 Aug 18 14:57:12.197896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 511/773] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:57:12.203364 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2b7b6ebe-2914-47b6-a74d-95b356179948 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:12.204195 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2b7b6ebe-2914-47b6-a74d-95b356179948 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:12.211328 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2b7b6ebe-2914-47b6-a74d-95b356179948 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:12.211992 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2b7b6ebe-2914-47b6-a74d-95b356179948 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:12.212633 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2b7b6ebe-2914-47b6-a74d-95b356179948 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:12.213403 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2b7b6ebe-2914-47b6-a74d-95b356179948 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:12.213962 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2b7b6ebe-2914-47b6-a74d-95b356179948 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:12.214396 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2b7b6ebe-2914-47b6-a74d-95b356179948 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:12.323721 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2b7b6ebe-2914-47b6-a74d-95b356179948 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:12.335243 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2b7b6ebe-2914-47b6-a74d-95b356179948 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 200 len: 1225 microversion: 2.1 time: 0.135772 Aug 18 14:57:12.336608 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 512/774] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:12 2022] GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 1225 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:57:12.504038 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-25b0e9a9-7e55-4d70-a4a6-4f4fa25c5d95 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:12.507163 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-25b0e9a9-7e55-4d70-a4a6-4f4fa25c5d95 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:12.514578 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-25b0e9a9-7e55-4d70-a4a6-4f4fa25c5d95 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:12.515501 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-25b0e9a9-7e55-4d70-a4a6-4f4fa25c5d95 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:12.516147 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-25b0e9a9-7e55-4d70-a4a6-4f4fa25c5d95 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:12.517163 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-25b0e9a9-7e55-4d70-a4a6-4f4fa25c5d95 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:12.517833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-25b0e9a9-7e55-4d70-a4a6-4f4fa25c5d95 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:12.518483 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-25b0e9a9-7e55-4d70-a4a6-4f4fa25c5d95 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:12.540042 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-25b0e9a9-7e55-4d70-a4a6-4f4fa25c5d95 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] HTTP exception thrown: Instance 0423b68b-575f-459e-a227-32d920e325cf could not be found. Aug 18 14:57:12.542005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-25b0e9a9-7e55-4d70-a4a6-4f4fa25c5d95 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Request method failure captured: Aug 18 14:57:12.542005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf HTTP/1.1 Aug 18 14:57:12.542005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:57:12.542005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:57:12.542005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:57:12.542005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:57:12.542005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:57:12.542005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:57:12.542005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:57:12.542005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:57:12.542005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lH4oIml6txed07XrppfY0Z5jhCeqS9LCxxoulg2eAhfaJ8WphU-pzn12EaO7FXV8VEwOuzjKQEfCBldz9fUbgppMEKJd_VSbDb_aR-Ce__ScpKEICpMOfadH5ZH-EfODQJGUEz0cyaOMRlNct6asFRrMu0s30r91ZjclG___yh0IIw Aug 18 14:57:12.542005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:57:12.542005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:57:12.542005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:57:12.542005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:57:12.542005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:57:12.542005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:57:12.542005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:57:12.542005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:57:12.542005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:57:12.542005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:57:12.543365 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_55c9fe0cbbfa47bca81668c039afc092", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:57:12.543365 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:57:12.543365 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:57:12.543365 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:57:12.543365 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:57:12.543365 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:57:12.543365 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:57:12.543365 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 36dbc938bcd741f2a2b2013b6aa6f008 Aug 18 14:57:12.543365 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:57:12.543365 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:57:12.543365 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 0423b68b-575f-459e-a227-32d920e325cf could not be found. Aug 18 14:57:12.543365 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '0423b68b-575f-459e-a227-32d920e325cf'} Aug 18 14:57:12.544375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:57:12.544375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:57:12.544375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:57:12.544375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:57:12.544375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:57:12.544375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:57:12.544375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:57:12.544375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:57:12.544375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:57:12.544375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:57:12.544375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0423b68b-575f-459e-a227-32d920e325cf could not be found. Aug 18 14:57:12.544375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:57:12.544375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:57:12.544375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:57:12.544375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:57:12.544375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:57:12.544375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:57:12.544375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:57:12.544375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:57:12.544375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:57:12.545668 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:57:12.545668 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:57:12.545668 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:57:12.545668 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:57:12.545668 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:57:12.545668 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:57:12.545668 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:57:12.545668 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0423b68b-575f-459e-a227-32d920e325cf could not be found. Aug 18 14:57:12.545668 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:57:12.545668 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:57:12.545668 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:57:12.545668 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:57:12.545668 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:57:12.545668 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:57:12.545668 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:57:12.545668 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:57:12.545668 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0423b68b-575f-459e-a227-32d920e325cf could not be found. Aug 18 14:57:12.545668 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:57:12.546799 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-25b0e9a9-7e55-4d70-a4a6-4f4fa25c5d95 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Returning 404 to user: Instance 0423b68b-575f-459e-a227-32d920e325cf could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:57:12.546799 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-25b0e9a9-7e55-4d70-a4a6-4f4fa25c5d95 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf" status: 404 len: 111 microversion: 2.1 time: 0.044763 Aug 18 14:57:12.549530 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 513/775] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:12 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 14:57:12.554791 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d8a4c52f-9a6e-4981-9f8a-46f2eee31070 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '.version_select at 0x7fb21406faf0>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:12.582464 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d8a4c52f-9a6e-4981-9f8a-46f2eee31070 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1804566728" status: 202 len: 0 microversion: 2.1 time: 0.031399 Aug 18 14:57:12.583599 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 514/776] 10.222.0.36 () {58 vars in 1221 bytes} [Thu Aug 18 14:57:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1804566728 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:57:13.302611 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-72cbb064-33e3-42e7-b908-1bf92fa3583f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Action: 'create', calling method: .version_select at 0x7fb21409c5e0>, body: {"keypair": {"name": "tempest-keypair-722574651", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9rODqFnmYkk2RcJcib42TRA1VpK1Vze3Zr7kOMHe/7YOP3SaD4rKUTpH7y6Gm1sSVSUtfzSdik+N5wK3zWfOEQSI6xOfkM6Ao6ypByPul/6CV01ht6PmxJVostT2fBpQ=="}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:57:13.320698 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-72cbb064-33e3-42e7-b908-1bf92fa3583f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Getting quotas for project 55c9fe0cbbfa47bca81668c039afc092. Resources: {'key_pairs'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:57:13.324548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-72cbb064-33e3-42e7-b908-1bf92fa3583f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Getting quotas for user 36dbc938bcd741f2a2b2013b6aa6f008 and project 55c9fe0cbbfa47bca81668c039afc092. Resources: {'key_pairs'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:57:13.326923 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:57:13.349319 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-72cbb064-33e3-42e7-b908-1bf92fa3583f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050666 Aug 18 14:57:13.356909 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 515/777] 10.222.0.36 () {60 vars in 1159 bytes} [Thu Aug 18 14:57:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:57:13.356909 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-322ab0b6-c307-4736-be71-84f3ee0d08e5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:13.358891 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-322ab0b6-c307-4736-be71-84f3ee0d08e5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:13.368475 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-322ab0b6-c307-4736-be71-84f3ee0d08e5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:13.369008 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-322ab0b6-c307-4736-be71-84f3ee0d08e5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:13.369455 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-322ab0b6-c307-4736-be71-84f3ee0d08e5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:13.370179 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-322ab0b6-c307-4736-be71-84f3ee0d08e5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:13.370643 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-322ab0b6-c307-4736-be71-84f3ee0d08e5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:13.371071 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-322ab0b6-c307-4736-be71-84f3ee0d08e5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:13.386108 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-322ab0b6-c307-4736-be71-84f3ee0d08e5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] HTTP exception thrown: Instance 80e04f79-c52c-4c8e-be85-d3beb6146729 could not be found. Aug 18 14:57:13.388178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-322ab0b6-c307-4736-be71-84f3ee0d08e5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Request method failure captured: Aug 18 14:57:13.388178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 HTTP/1.1 Aug 18 14:57:13.388178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:57:13.388178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:57:13.388178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:57:13.388178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:57:13.388178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:57:13.388178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:57:13.388178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:57:13.388178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:57:13.388178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lJfb-SS07HrKZYcnm0G93u-17_L-cy6H6p9IUQ5JWnD4JLMgxjRx4rRInyQZrAiQOqhb0KlPc-b92LLcz2UnJSsIwaEdO77sQZtc5L3bkSGa-hFFeGrk6WjrVOdYdqjIrq30lNVSwhOovQUG0gHU-XEiaYHlZ9LXcGO3leSj93R1rc Aug 18 14:57:13.388178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:57:13.388178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:57:13.388178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:57:13.388178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:57:13.388178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:57:13.388178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:57:13.388178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: d334ad6bd6194604a61ce4ca95149993 Aug 18 14:57:13.388178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-TestVolumeBootPattern-1402032980 Aug 18 14:57:13.388178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:57:13.388178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:57:13.389766 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d334ad6bd6194604a61ce4ca95149993"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d334ad6bd6194604a61ce4ca95149993"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d334ad6bd6194604a61ce4ca95149993", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d334ad6bd6194604a61ce4ca95149993"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:57:13.389766 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-TestVolumeBootPattern-1402032980 Aug 18 14:57:13.389766 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: d334ad6bd6194604a61ce4ca95149993 Aug 18 14:57:13.389766 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-TestVolumeBootPattern-1402032980 Aug 18 14:57:13.389766 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-TestVolumeBootPattern-1402032980-project Aug 18 14:57:13.389766 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:57:13.389766 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:57:13.389766 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: ac4d918f549c41d3ae19e80cecefa95c Aug 18 14:57:13.389766 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-TestVolumeBootPattern-1402032980-project Aug 18 14:57:13.389766 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:57:13.389766 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 80e04f79-c52c-4c8e-be85-d3beb6146729 could not be found. Aug 18 14:57:13.389766 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '80e04f79-c52c-4c8e-be85-d3beb6146729'} Aug 18 14:57:13.390635 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:57:13.390635 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:57:13.390635 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:57:13.390635 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:57:13.390635 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:57:13.390635 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:57:13.390635 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:57:13.390635 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:57:13.390635 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:57:13.390635 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:57:13.390635 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80e04f79-c52c-4c8e-be85-d3beb6146729 could not be found. Aug 18 14:57:13.390635 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:57:13.390635 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:57:13.390635 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:57:13.390635 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:57:13.390635 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:57:13.390635 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:57:13.390635 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:57:13.390635 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:57:13.390635 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:57:13.391856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:57:13.391856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:57:13.391856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:57:13.391856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:57:13.391856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:57:13.391856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:57:13.391856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:57:13.391856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80e04f79-c52c-4c8e-be85-d3beb6146729 could not be found. Aug 18 14:57:13.391856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:57:13.391856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:57:13.391856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:57:13.391856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:57:13.391856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:57:13.391856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:57:13.391856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:57:13.391856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:57:13.391856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80e04f79-c52c-4c8e-be85-d3beb6146729 could not be found. Aug 18 14:57:13.391856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:57:13.392920 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-322ab0b6-c307-4736-be71-84f3ee0d08e5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Returning 404 to user: Instance 80e04f79-c52c-4c8e-be85-d3beb6146729 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:57:13.393385 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-322ab0b6-c307-4736-be71-84f3ee0d08e5 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 404 len: 111 microversion: 2.1 time: 0.040787 Aug 18 14:57:13.394118 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 516/778] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:13 2022] GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 14:57:13.501835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-69401cf6-e974-417f-9983-c7301dec37f8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-443478080", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-198073082", "security_groups": [{"name": "tempest-secgroup-smoke-456689280"}], "block_device_mapping_v2": [{"uuid": "3d258111-6c50-45c5-8367-8cc6883b6ba4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "24aebd51-9a3b-4fcd-801c-0a194132131f"}]}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:57:13.671724 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.network.neutron [None req-69401cf6-e974-417f-9983-c7301dec37f8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] validate_networks() for [('24aebd51-9a3b-4fcd-801c-0a194132131f', None, None, None, None, None)] {{(pid=132268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:57:14.284611 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-69401cf6-e974-417f-9983-c7301dec37f8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Flavor limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:57:14.285034 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-69401cf6-e974-417f-9983-c7301dec37f8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Image limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:57:14.285506 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-69401cf6-e974-417f-9983-c7301dec37f8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Flavor pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:57:14.286505 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-69401cf6-e974-417f-9983-c7301dec37f8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Image pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:57:14.286915 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-69401cf6-e974-417f-9983-c7301dec37f8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:57:14.295978 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-69401cf6-e974-417f-9983-c7301dec37f8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:14.296490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-69401cf6-e974-417f-9983-c7301dec37f8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:14.296923 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-69401cf6-e974-417f-9983-c7301dec37f8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:14.297643 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-69401cf6-e974-417f-9983-c7301dec37f8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:14.298095 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-69401cf6-e974-417f-9983-c7301dec37f8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:14.298516 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-69401cf6-e974-417f-9983-c7301dec37f8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:14.315436 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-69401cf6-e974-417f-9983-c7301dec37f8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Getting quotas for project d334ad6bd6194604a61ce4ca95149993. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:57:14.319429 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-69401cf6-e974-417f-9983-c7301dec37f8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Getting quotas for user ac4d918f549c41d3ae19e80cecefa95c and project d334ad6bd6194604a61ce4ca95149993. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:57:14.378326 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-69401cf6-e974-417f-9983-c7301dec37f8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Going to run 1 instances... {{(pid=132268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:57:14.380682 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-69401cf6-e974-417f-9983-c7301dec37f8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 26c1eb76-2063-4c0d-80a1-6c0d9baaace4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3d258111-6c50-45c5-8367-8cc6883b6ba4',volume_size=None,volume_type=None)] {{(pid=132268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:57:14.520465 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-69401cf6-e974-417f-9983-c7301dec37f8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.022387 Aug 18 14:57:14.527102 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 517/779] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Aug 18 14:57:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 14:57:14.532315 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-9c966097-1a78-413b-b32b-6612f9c85c5a tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:14.533242 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-9c966097-1a78-413b-b32b-6612f9c85c5a tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 26c1eb76-2063-4c0d-80a1-6c0d9baaace4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:14.600077 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-9c966097-1a78-413b-b32b-6612f9c85c5a tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:14.608559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-9c966097-1a78-413b-b32b-6612f9c85c5a tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4" status: 200 len: 1093 microversion: 2.1 time: 0.080139 Aug 18 14:57:14.609141 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 518/780] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:14 2022] GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4 => generated 1093 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:57:14.962485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-4347acce-e52e-4045-a4a7-c6185d188098 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1495001564", "imageRef": "4083d76b-6b95-4ed8-8053-69a1270afbd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93c9a460-c99c-4e1d-ba82-dd7168d9fd6a"}], "security_groups": [{"name": "tempest-securitygroup--1535697862"}], "key_name": "tempest-keypair-722574651", "user_data": "}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:57:15.074371 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.network.neutron [None req-4347acce-e52e-4045-a4a7-c6185d188098 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] validate_networks() for [('93c9a460-c99c-4e1d-ba82-dd7168d9fd6a', None, None, None, None, None)] {{(pid=132268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:57:15.452856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-4347acce-e52e-4045-a4a7-c6185d188098 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Flavor limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:57:15.453489 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-4347acce-e52e-4045-a4a7-c6185d188098 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Image limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:57:15.453732 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-4347acce-e52e-4045-a4a7-c6185d188098 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Flavor pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:57:15.454176 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-4347acce-e52e-4045-a4a7-c6185d188098 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Image pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:57:15.454543 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-4347acce-e52e-4045-a4a7-c6185d188098 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:57:15.464427 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4347acce-e52e-4045-a4a7-c6185d188098 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:15.465624 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4347acce-e52e-4045-a4a7-c6185d188098 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:15.466073 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4347acce-e52e-4045-a4a7-c6185d188098 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:15.466983 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4347acce-e52e-4045-a4a7-c6185d188098 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:15.467449 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4347acce-e52e-4045-a4a7-c6185d188098 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:15.467911 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4347acce-e52e-4045-a4a7-c6185d188098 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:15.486382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-4347acce-e52e-4045-a4a7-c6185d188098 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Getting quotas for project 55c9fe0cbbfa47bca81668c039afc092. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:57:15.490314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-4347acce-e52e-4045-a4a7-c6185d188098 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Getting quotas for user 36dbc938bcd741f2a2b2013b6aa6f008 and project 55c9fe0cbbfa47bca81668c039afc092. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:57:15.501359 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-4347acce-e52e-4045-a4a7-c6185d188098 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Going to run 1 instances... {{(pid=132268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:57:15.503576 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-4347acce-e52e-4045-a4a7-c6185d188098 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4083d76b-6b95-4ed8-8053-69a1270afbd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:57:15.551316 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-4347acce-e52e-4045-a4a7-c6185d188098 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.594368 Aug 18 14:57:15.552978 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 519/781] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Aug 18 14:57:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:57:15.564972 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-7d8c3115-4ae3-433e-8aeb-1c7db3798d00 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:15.565634 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-7d8c3115-4ae3-433e-8aeb-1c7db3798d00 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:15.622334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-7d8c3115-4ae3-433e-8aeb-1c7db3798d00 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:15.635286 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-7d8c3115-4ae3-433e-8aeb-1c7db3798d00 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86" status: 200 len: 1241 microversion: 2.1 time: 0.074294 Aug 18 14:57:15.636598 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 520/782] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:15 2022] GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:57:15.645110 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-05440940-eae6-47de-9cfa-dd36e8634c77 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:15.646373 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-05440940-eae6-47de-9cfa-dd36e8634c77 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 26c1eb76-2063-4c0d-80a1-6c0d9baaace4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:15.657432 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-05440940-eae6-47de-9cfa-dd36e8634c77 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:15.657932 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-05440940-eae6-47de-9cfa-dd36e8634c77 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:15.658468 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-05440940-eae6-47de-9cfa-dd36e8634c77 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:15.659431 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-05440940-eae6-47de-9cfa-dd36e8634c77 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:15.659939 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-05440940-eae6-47de-9cfa-dd36e8634c77 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:15.660388 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-05440940-eae6-47de-9cfa-dd36e8634c77 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:15.742961 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-05440940-eae6-47de-9cfa-dd36e8634c77 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:15.758670 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-05440940-eae6-47de-9cfa-dd36e8634c77 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4" status: 200 len: 1199 microversion: 2.1 time: 0.120201 Aug 18 14:57:15.760120 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 521/783] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:15 2022] GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4 => generated 1199 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:57:16.658819 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0a03f023-5ff7-4e5a-b907-c1b79c3ea6d9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:16.659500 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0a03f023-5ff7-4e5a-b907-c1b79c3ea6d9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:16.666988 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0a03f023-5ff7-4e5a-b907-c1b79c3ea6d9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:16.667603 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0a03f023-5ff7-4e5a-b907-c1b79c3ea6d9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:16.668238 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0a03f023-5ff7-4e5a-b907-c1b79c3ea6d9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:16.668944 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0a03f023-5ff7-4e5a-b907-c1b79c3ea6d9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:16.669439 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0a03f023-5ff7-4e5a-b907-c1b79c3ea6d9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:16.670099 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0a03f023-5ff7-4e5a-b907-c1b79c3ea6d9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:16.796137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-0a03f023-5ff7-4e5a-b907-c1b79c3ea6d9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:16.804591 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0a03f023-5ff7-4e5a-b907-c1b79c3ea6d9 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86" status: 200 len: 1293 microversion: 2.1 time: 0.149703 Aug 18 14:57:16.819793 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 522/784] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:16 2022] GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86 => generated 1293 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:16.826826 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e492fd84-4cf4-4438-883b-ce27c6cebda8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:16.827789 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e492fd84-4cf4-4438-883b-ce27c6cebda8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 26c1eb76-2063-4c0d-80a1-6c0d9baaace4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:16.835060 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e492fd84-4cf4-4438-883b-ce27c6cebda8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:16.835890 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e492fd84-4cf4-4438-883b-ce27c6cebda8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:16.836551 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e492fd84-4cf4-4438-883b-ce27c6cebda8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:16.837497 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e492fd84-4cf4-4438-883b-ce27c6cebda8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:16.838179 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e492fd84-4cf4-4438-883b-ce27c6cebda8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:16.838817 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e492fd84-4cf4-4438-883b-ce27c6cebda8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:17.157679 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e492fd84-4cf4-4438-883b-ce27c6cebda8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:17.159905 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:57:17.166636 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e492fd84-4cf4-4438-883b-ce27c6cebda8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4" status: 200 len: 1276 microversion: 2.1 time: 0.344895 Aug 18 14:57:17.167212 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 523/785] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:16 2022] GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4 => generated 1276 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:57:17.826602 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-607f2e28-03d8-4f40-ba24-5d0b0212c5b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:17.827241 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-607f2e28-03d8-4f40-ba24-5d0b0212c5b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:17.836927 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-607f2e28-03d8-4f40-ba24-5d0b0212c5b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:17.837359 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-607f2e28-03d8-4f40-ba24-5d0b0212c5b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:17.837802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-607f2e28-03d8-4f40-ba24-5d0b0212c5b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:17.838509 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-607f2e28-03d8-4f40-ba24-5d0b0212c5b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:17.838969 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-607f2e28-03d8-4f40-ba24-5d0b0212c5b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:17.839399 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-607f2e28-03d8-4f40-ba24-5d0b0212c5b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:17.926001 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-607f2e28-03d8-4f40-ba24-5d0b0212c5b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:17.934292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-607f2e28-03d8-4f40-ba24-5d0b0212c5b6 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86" status: 200 len: 1299 microversion: 2.1 time: 0.111708 Aug 18 14:57:17.934865 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 524/786] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:17 2022] GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86 => generated 1299 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:18.163200 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-5ceea175-c0b6-449b-ac2c-68249fa3d259 req-2c64c483-4423-4614-8426-ed13b6f77187 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26c1eb76-2063-4c0d-80a1-6c0d9baaace4", "tag": "87aea118-6682-42ff-87ca-60d074c906df"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:57:18.172845 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-5ceea175-c0b6-449b-ac2c-68249fa3d259 req-2c64c483-4423-4614-8426-ed13b6f77187 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:18.173499 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-5ceea175-c0b6-449b-ac2c-68249fa3d259 req-2c64c483-4423-4614-8426-ed13b6f77187 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:18.173762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-5ceea175-c0b6-449b-ac2c-68249fa3d259 req-2c64c483-4423-4614-8426-ed13b6f77187 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:18.187384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-5ceea175-c0b6-449b-ac2c-68249fa3d259 req-2c64c483-4423-4614-8426-ed13b6f77187 service nova] Creating event network-changed:87aea118-6682-42ff-87ca-60d074c906df for instance 26c1eb76-2063-4c0d-80a1-6c0d9baaace4 on hv-cinder-85220 Aug 18 14:57:18.193311 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-5ceea175-c0b6-449b-ac2c-68249fa3d259 req-2c64c483-4423-4614-8426-ed13b6f77187 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098571 Aug 18 14:57:18.193899 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 525/787] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:57:18.198951 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-1ab6e80f-67ba-4550-8e30-6d8d0c3fe391 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:18.199659 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-1ab6e80f-67ba-4550-8e30-6d8d0c3fe391 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 26c1eb76-2063-4c0d-80a1-6c0d9baaace4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:18.206089 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1ab6e80f-67ba-4550-8e30-6d8d0c3fe391 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:18.206618 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1ab6e80f-67ba-4550-8e30-6d8d0c3fe391 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:18.207081 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1ab6e80f-67ba-4550-8e30-6d8d0c3fe391 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:18.207826 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1ab6e80f-67ba-4550-8e30-6d8d0c3fe391 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:18.208287 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1ab6e80f-67ba-4550-8e30-6d8d0c3fe391 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:18.208715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1ab6e80f-67ba-4550-8e30-6d8d0c3fe391 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:18.545861 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-1ab6e80f-67ba-4550-8e30-6d8d0c3fe391 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:18.557165 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-1ab6e80f-67ba-4550-8e30-6d8d0c3fe391 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4" status: 200 len: 1264 microversion: 2.1 time: 0.361532 Aug 18 14:57:18.558099 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 526/788] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:18 2022] GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4 => generated 1264 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:57:18.956246 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-90ba5e71-c022-479d-812b-01e309997dd1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:18.956950 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-90ba5e71-c022-479d-812b-01e309997dd1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:18.963935 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-90ba5e71-c022-479d-812b-01e309997dd1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:18.964427 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-90ba5e71-c022-479d-812b-01e309997dd1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:18.964859 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-90ba5e71-c022-479d-812b-01e309997dd1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:18.965548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-90ba5e71-c022-479d-812b-01e309997dd1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:18.966004 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-90ba5e71-c022-479d-812b-01e309997dd1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:18.966422 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-90ba5e71-c022-479d-812b-01e309997dd1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:19.168625 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-90ba5e71-c022-479d-812b-01e309997dd1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:19.177638 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-90ba5e71-c022-479d-812b-01e309997dd1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86" status: 200 len: 1367 microversion: 2.1 time: 0.225295 Aug 18 14:57:19.178158 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 527/789] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:18 2022] GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:19.579319 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b3011421-fb5b-4971-b04b-c5038d17f6b6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:19.580063 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b3011421-fb5b-4971-b04b-c5038d17f6b6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 26c1eb76-2063-4c0d-80a1-6c0d9baaace4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:19.588479 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b3011421-fb5b-4971-b04b-c5038d17f6b6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:19.588717 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b3011421-fb5b-4971-b04b-c5038d17f6b6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:19.589585 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b3011421-fb5b-4971-b04b-c5038d17f6b6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:19.590119 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b3011421-fb5b-4971-b04b-c5038d17f6b6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:19.590585 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b3011421-fb5b-4971-b04b-c5038d17f6b6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:19.591065 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b3011421-fb5b-4971-b04b-c5038d17f6b6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:19.895734 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b3011421-fb5b-4971-b04b-c5038d17f6b6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:19.903960 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b3011421-fb5b-4971-b04b-c5038d17f6b6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4" status: 200 len: 1264 microversion: 2.1 time: 0.328490 Aug 18 14:57:19.904545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 528/790] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:19 2022] GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4 => generated 1264 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:57:20.198721 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-4376d600-dd62-43e9-8ae0-b4d974732463 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:20.199332 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-4376d600-dd62-43e9-8ae0-b4d974732463 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:20.206036 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4376d600-dd62-43e9-8ae0-b4d974732463 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:20.206525 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4376d600-dd62-43e9-8ae0-b4d974732463 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:20.207012 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4376d600-dd62-43e9-8ae0-b4d974732463 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:20.208262 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4376d600-dd62-43e9-8ae0-b4d974732463 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:20.208733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4376d600-dd62-43e9-8ae0-b4d974732463 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:20.209156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4376d600-dd62-43e9-8ae0-b4d974732463 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:20.380248 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-4376d600-dd62-43e9-8ae0-b4d974732463 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:20.388861 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-4376d600-dd62-43e9-8ae0-b4d974732463 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86" status: 200 len: 1367 microversion: 2.1 time: 0.194053 Aug 18 14:57:20.389427 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 529/791] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:20 2022] GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:20.393831 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-e2f9837d-7b66-4c94-bf8b-cf8bf6768083 req-fe755807-ae5e-42ba-954f-de6f7996e903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b930f52-a56c-4003-b85a-bf2905b6ba86", "tag": "173256a4-b50a-40ae-8f25-84e06b5fe723"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:57:20.402830 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-e2f9837d-7b66-4c94-bf8b-cf8bf6768083 req-fe755807-ae5e-42ba-954f-de6f7996e903 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:20.403306 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-e2f9837d-7b66-4c94-bf8b-cf8bf6768083 req-fe755807-ae5e-42ba-954f-de6f7996e903 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:20.403762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-e2f9837d-7b66-4c94-bf8b-cf8bf6768083 req-fe755807-ae5e-42ba-954f-de6f7996e903 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:20.414750 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-e2f9837d-7b66-4c94-bf8b-cf8bf6768083 req-fe755807-ae5e-42ba-954f-de6f7996e903 service nova] Creating event network-changed:173256a4-b50a-40ae-8f25-84e06b5fe723 for instance 3b930f52-a56c-4003-b85a-bf2905b6ba86 on hv-cinder-85220 Aug 18 14:57:20.419477 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-e2f9837d-7b66-4c94-bf8b-cf8bf6768083 req-fe755807-ae5e-42ba-954f-de6f7996e903 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028974 Aug 18 14:57:20.420073 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 530/792] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:57:20.925532 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-38d55d4d-3230-4408-931f-32a44b7010f9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:20.926466 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-38d55d4d-3230-4408-931f-32a44b7010f9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 26c1eb76-2063-4c0d-80a1-6c0d9baaace4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:20.932722 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-38d55d4d-3230-4408-931f-32a44b7010f9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:20.933200 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-38d55d4d-3230-4408-931f-32a44b7010f9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:20.933630 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-38d55d4d-3230-4408-931f-32a44b7010f9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:20.934315 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-38d55d4d-3230-4408-931f-32a44b7010f9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:20.934763 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-38d55d4d-3230-4408-931f-32a44b7010f9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:20.935183 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-38d55d4d-3230-4408-931f-32a44b7010f9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:21.068760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-38d55d4d-3230-4408-931f-32a44b7010f9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:21.076461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-38d55d4d-3230-4408-931f-32a44b7010f9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4" status: 200 len: 1264 microversion: 2.1 time: 0.155306 Aug 18 14:57:21.077011 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 531/793] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:20 2022] GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:21.410418 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a26161e4-3e93-483e-9310-9b16794613ac tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:21.411092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a26161e4-3e93-483e-9310-9b16794613ac tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:21.417624 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a26161e4-3e93-483e-9310-9b16794613ac tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:21.418176 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a26161e4-3e93-483e-9310-9b16794613ac tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:21.418678 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a26161e4-3e93-483e-9310-9b16794613ac tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:21.419371 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a26161e4-3e93-483e-9310-9b16794613ac tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:21.419846 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a26161e4-3e93-483e-9310-9b16794613ac tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:21.420274 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a26161e4-3e93-483e-9310-9b16794613ac tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:21.865337 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a26161e4-3e93-483e-9310-9b16794613ac tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:21.872739 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a26161e4-3e93-483e-9310-9b16794613ac tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86" status: 200 len: 1367 microversion: 2.1 time: 0.466236 Aug 18 14:57:21.886596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 532/794] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:21 2022] GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86 => generated 1367 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:22.097808 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-380e8b9d-fdc1-4fde-83f4-093321de24d6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:22.098537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-380e8b9d-fdc1-4fde-83f4-093321de24d6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 26c1eb76-2063-4c0d-80a1-6c0d9baaace4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:22.105097 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-380e8b9d-fdc1-4fde-83f4-093321de24d6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:22.105679 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-380e8b9d-fdc1-4fde-83f4-093321de24d6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:22.106189 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-380e8b9d-fdc1-4fde-83f4-093321de24d6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:22.106978 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-380e8b9d-fdc1-4fde-83f4-093321de24d6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:22.107578 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-380e8b9d-fdc1-4fde-83f4-093321de24d6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:22.108103 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-380e8b9d-fdc1-4fde-83f4-093321de24d6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:22.315388 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-380e8b9d-fdc1-4fde-83f4-093321de24d6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:22.324824 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-380e8b9d-fdc1-4fde-83f4-093321de24d6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4" status: 200 len: 1264 microversion: 2.1 time: 0.230967 Aug 18 14:57:22.325607 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 533/795] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:22 2022] GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4 => generated 1264 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:22.894216 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-50fd0e2a-451e-4312-a0b1-4ea6b64ffc38 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:22.894969 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-50fd0e2a-451e-4312-a0b1-4ea6b64ffc38 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:22.902199 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-50fd0e2a-451e-4312-a0b1-4ea6b64ffc38 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:22.902686 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-50fd0e2a-451e-4312-a0b1-4ea6b64ffc38 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:22.903123 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-50fd0e2a-451e-4312-a0b1-4ea6b64ffc38 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:22.903852 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-50fd0e2a-451e-4312-a0b1-4ea6b64ffc38 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:22.904307 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-50fd0e2a-451e-4312-a0b1-4ea6b64ffc38 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:22.904730 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-50fd0e2a-451e-4312-a0b1-4ea6b64ffc38 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:23.039450 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-50fd0e2a-451e-4312-a0b1-4ea6b64ffc38 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:23.047300 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-50fd0e2a-451e-4312-a0b1-4ea6b64ffc38 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86" status: 200 len: 1367 microversion: 2.1 time: 0.157043 Aug 18 14:57:23.047880 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 534/796] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:22 2022] GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:23.154868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d9091223-4609-4bd8-9027-f4846db901c5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:23.155359 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d9091223-4609-4bd8-9027-f4846db901c5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:23.161666 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d9091223-4609-4bd8-9027-f4846db901c5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:23.162273 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d9091223-4609-4bd8-9027-f4846db901c5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:23.162688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d9091223-4609-4bd8-9027-f4846db901c5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:23.163575 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d9091223-4609-4bd8-9027-f4846db901c5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:23.164047 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d9091223-4609-4bd8-9027-f4846db901c5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:23.164522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d9091223-4609-4bd8-9027-f4846db901c5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:23.189466 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d9091223-4609-4bd8-9027-f4846db901c5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1/ips" status: 200 len: 151 microversion: 2.20 time: 0.038099 Aug 18 14:57:23.190285 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 535/797] 10.222.0.36 () {60 vars in 1289 bytes} [Thu Aug 18 14:57:23 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 14:57:23.347005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-26f32964-93c9-489b-b5c6-3c1461a5fb26 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:23.347620 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-26f32964-93c9-489b-b5c6-3c1461a5fb26 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 26c1eb76-2063-4c0d-80a1-6c0d9baaace4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:23.353734 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26f32964-93c9-489b-b5c6-3c1461a5fb26 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:23.354222 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26f32964-93c9-489b-b5c6-3c1461a5fb26 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:23.354656 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26f32964-93c9-489b-b5c6-3c1461a5fb26 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:23.355346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26f32964-93c9-489b-b5c6-3c1461a5fb26 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:23.355982 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26f32964-93c9-489b-b5c6-3c1461a5fb26 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:23.356419 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26f32964-93c9-489b-b5c6-3c1461a5fb26 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:23.501231 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-26f32964-93c9-489b-b5c6-3c1461a5fb26 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:23.509062 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-26f32964-93c9-489b-b5c6-3c1461a5fb26 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4" status: 200 len: 1264 microversion: 2.1 time: 0.166314 Aug 18 14:57:23.509622 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 536/798] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:23 2022] GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:24.072373 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-bd9b5e0a-52ad-4176-af58-449eb0a9da9b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:24.073109 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-bd9b5e0a-52ad-4176-af58-449eb0a9da9b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:24.079656 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bd9b5e0a-52ad-4176-af58-449eb0a9da9b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:24.080170 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bd9b5e0a-52ad-4176-af58-449eb0a9da9b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:24.080601 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bd9b5e0a-52ad-4176-af58-449eb0a9da9b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:24.081297 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bd9b5e0a-52ad-4176-af58-449eb0a9da9b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:24.081743 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bd9b5e0a-52ad-4176-af58-449eb0a9da9b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:24.082160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bd9b5e0a-52ad-4176-af58-449eb0a9da9b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:24.221888 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-bd9b5e0a-52ad-4176-af58-449eb0a9da9b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:24.229622 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-bd9b5e0a-52ad-4176-af58-449eb0a9da9b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86" status: 200 len: 1367 microversion: 2.1 time: 0.161220 Aug 18 14:57:24.230193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 537/799] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:24 2022] GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:24.296973 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-da6719a4-bffc-4a28-9f79-7a31b5fb9f47 req-cf5be0c1-0729-4803-8140-b92d4fe07f2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b930f52-a56c-4003-b85a-bf2905b6ba86", "name": "network-vif-plugged", "status": "completed", "tag": "173256a4-b50a-40ae-8f25-84e06b5fe723"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:57:24.306897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-da6719a4-bffc-4a28-9f79-7a31b5fb9f47 req-cf5be0c1-0729-4803-8140-b92d4fe07f2f service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:24.307371 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-da6719a4-bffc-4a28-9f79-7a31b5fb9f47 req-cf5be0c1-0729-4803-8140-b92d4fe07f2f service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:24.307962 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-da6719a4-bffc-4a28-9f79-7a31b5fb9f47 req-cf5be0c1-0729-4803-8140-b92d4fe07f2f service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:24.319197 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-da6719a4-bffc-4a28-9f79-7a31b5fb9f47 req-cf5be0c1-0729-4803-8140-b92d4fe07f2f service nova] Creating event network-vif-plugged:173256a4-b50a-40ae-8f25-84e06b5fe723 for instance 3b930f52-a56c-4003-b85a-bf2905b6ba86 on hv-cinder-85220 Aug 18 14:57:24.324134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-da6719a4-bffc-4a28-9f79-7a31b5fb9f47 req-cf5be0c1-0729-4803-8140-b92d4fe07f2f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092535 Aug 18 14:57:24.324652 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 538/800] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:57:24.530873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-6c486a33-54c1-4201-9a20-5237117f4d2b tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:24.531567 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-6c486a33-54c1-4201-9a20-5237117f4d2b tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 26c1eb76-2063-4c0d-80a1-6c0d9baaace4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:24.538347 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6c486a33-54c1-4201-9a20-5237117f4d2b tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:24.538857 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6c486a33-54c1-4201-9a20-5237117f4d2b tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:24.539274 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6c486a33-54c1-4201-9a20-5237117f4d2b tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:24.539979 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6c486a33-54c1-4201-9a20-5237117f4d2b tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:24.540428 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6c486a33-54c1-4201-9a20-5237117f4d2b tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:24.540844 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6c486a33-54c1-4201-9a20-5237117f4d2b tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:24.673620 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6c486a33-54c1-4201-9a20-5237117f4d2b tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:24.682843 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-6c486a33-54c1-4201-9a20-5237117f4d2b tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4" status: 200 len: 1264 microversion: 2.1 time: 0.156230 Aug 18 14:57:24.683427 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 539/801] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:24 2022] GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:25.251586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-15a11b60-df3a-4093-be7f-a7d80dec2cb8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:25.252268 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-15a11b60-df3a-4093-be7f-a7d80dec2cb8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:25.259049 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-15a11b60-df3a-4093-be7f-a7d80dec2cb8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:25.259534 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-15a11b60-df3a-4093-be7f-a7d80dec2cb8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:25.259994 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-15a11b60-df3a-4093-be7f-a7d80dec2cb8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:25.260675 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-15a11b60-df3a-4093-be7f-a7d80dec2cb8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:25.261123 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-15a11b60-df3a-4093-be7f-a7d80dec2cb8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:25.261541 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-15a11b60-df3a-4093-be7f-a7d80dec2cb8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:25.431480 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-15a11b60-df3a-4093-be7f-a7d80dec2cb8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:25.439358 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-15a11b60-df3a-4093-be7f-a7d80dec2cb8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86" status: 200 len: 1367 microversion: 2.1 time: 0.191759 Aug 18 14:57:25.439942 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 540/802] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:25 2022] GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:25.705599 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a46e9ae9-2024-4659-8678-1d2b5c16040f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:25.706220 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a46e9ae9-2024-4659-8678-1d2b5c16040f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 26c1eb76-2063-4c0d-80a1-6c0d9baaace4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:25.708292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=4 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:57:25.708998 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=20 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:57:25.714997 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a46e9ae9-2024-4659-8678-1d2b5c16040f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:25.715473 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a46e9ae9-2024-4659-8678-1d2b5c16040f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:25.715938 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a46e9ae9-2024-4659-8678-1d2b5c16040f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:25.716637 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a46e9ae9-2024-4659-8678-1d2b5c16040f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:25.717095 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a46e9ae9-2024-4659-8678-1d2b5c16040f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:25.717520 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a46e9ae9-2024-4659-8678-1d2b5c16040f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:25.851069 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a46e9ae9-2024-4659-8678-1d2b5c16040f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:25.859040 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a46e9ae9-2024-4659-8678-1d2b5c16040f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4" status: 200 len: 1264 microversion: 2.1 time: 0.157316 Aug 18 14:57:25.859612 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 541/803] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:25 2022] GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:26.220384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b2149619-0fa2-4df0-8c34-245ad7c19e18 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:57:26.220919 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b2149619-0fa2-4df0-8c34-245ad7c19e18 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:26.227437 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b2149619-0fa2-4df0-8c34-245ad7c19e18 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:26.227892 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b2149619-0fa2-4df0-8c34-245ad7c19e18 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:26.228325 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b2149619-0fa2-4df0-8c34-245ad7c19e18 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:26.229005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b2149619-0fa2-4df0-8c34-245ad7c19e18 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:26.229453 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b2149619-0fa2-4df0-8c34-245ad7c19e18 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:26.229902 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b2149619-0fa2-4df0-8c34-245ad7c19e18 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:26.252123 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.objects.instance [None req-b2149619-0fa2-4df0-8c34-245ad7c19e18 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lazy-loading 'flavor' on Instance uuid 1cb0c027-abae-485d-a0b8-c57e5286d2b1 {{(pid=132268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:57:26.255502 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=100 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:57:26.431185 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b2149619-0fa2-4df0-8c34-245ad7c19e18 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "POST /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1/action" status: 202 len: 0 microversion: 2.20 time: 0.214283 Aug 18 14:57:26.431967 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 542/804] 10.222.0.36 () {62 vars in 1319 bytes} [Thu Aug 18 14:57:26 2022] POST /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 18 14:57:26.440459 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-35d904cd-9958-4abf-af76-a79466c155a5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:26.441165 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-35d904cd-9958-4abf-af76-a79466c155a5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:26.450189 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-35d904cd-9958-4abf-af76-a79466c155a5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:26.450756 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-35d904cd-9958-4abf-af76-a79466c155a5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:26.451295 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-35d904cd-9958-4abf-af76-a79466c155a5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:26.452217 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-35d904cd-9958-4abf-af76-a79466c155a5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:26.452875 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-35d904cd-9958-4abf-af76-a79466c155a5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:26.453431 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-35d904cd-9958-4abf-af76-a79466c155a5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:26.599017 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-35d904cd-9958-4abf-af76-a79466c155a5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:26.607569 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-35d904cd-9958-4abf-af76-a79466c155a5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:26.609292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-35d904cd-9958-4abf-af76-a79466c155a5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:26.610460 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-35d904cd-9958-4abf-af76-a79466c155a5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1722 microversion: 2.20 time: 0.174004 Aug 18 14:57:26.623709 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 543/805] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:26 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:57:26.623709 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-749bce30-3b48-461d-b69e-0ff951944935 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:26.623709 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-749bce30-3b48-461d-b69e-0ff951944935 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:26.623709 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-749bce30-3b48-461d-b69e-0ff951944935 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:26.624172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-749bce30-3b48-461d-b69e-0ff951944935 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:26.624172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-749bce30-3b48-461d-b69e-0ff951944935 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:26.624172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-749bce30-3b48-461d-b69e-0ff951944935 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:26.624438 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-749bce30-3b48-461d-b69e-0ff951944935 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:26.624718 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-749bce30-3b48-461d-b69e-0ff951944935 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:26.767970 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-749bce30-3b48-461d-b69e-0ff951944935 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:26.776405 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-749bce30-3b48-461d-b69e-0ff951944935 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86" status: 200 len: 1367 microversion: 2.1 time: 0.164416 Aug 18 14:57:26.776973 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 544/806] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:26 2022] GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:57:26.880426 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-52afc86d-801c-46d3-ae3f-d6c241b63528 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:26.881213 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-52afc86d-801c-46d3-ae3f-d6c241b63528 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 26c1eb76-2063-4c0d-80a1-6c0d9baaace4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:26.883350 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:57:26.889097 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-52afc86d-801c-46d3-ae3f-d6c241b63528 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:26.889583 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-52afc86d-801c-46d3-ae3f-d6c241b63528 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:26.890023 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-52afc86d-801c-46d3-ae3f-d6c241b63528 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:26.890719 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-52afc86d-801c-46d3-ae3f-d6c241b63528 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:26.891178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-52afc86d-801c-46d3-ae3f-d6c241b63528 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:26.891605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-52afc86d-801c-46d3-ae3f-d6c241b63528 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:27.023475 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-52afc86d-801c-46d3-ae3f-d6c241b63528 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:27.031313 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-52afc86d-801c-46d3-ae3f-d6c241b63528 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4" status: 200 len: 1264 microversion: 2.1 time: 0.155314 Aug 18 14:57:27.031905 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 545/807] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:26 2022] GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:27.636072 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-1208f56b-8e93-48ac-badb-233888c22d11 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:27.636763 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-1208f56b-8e93-48ac-badb-233888c22d11 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:27.643444 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1208f56b-8e93-48ac-badb-233888c22d11 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:27.643960 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1208f56b-8e93-48ac-badb-233888c22d11 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:27.644401 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1208f56b-8e93-48ac-badb-233888c22d11 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:27.645685 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1208f56b-8e93-48ac-badb-233888c22d11 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:27.646164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1208f56b-8e93-48ac-badb-233888c22d11 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:27.646593 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1208f56b-8e93-48ac-badb-233888c22d11 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:27.778878 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-1208f56b-8e93-48ac-badb-233888c22d11 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:27.787010 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-1208f56b-8e93-48ac-badb-233888c22d11 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:27.788525 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-1208f56b-8e93-48ac-badb-233888c22d11 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:27.789686 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-1208f56b-8e93-48ac-badb-233888c22d11 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1722 microversion: 2.20 time: 0.157750 Aug 18 14:57:27.790237 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 546/808] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:27 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:57:27.797082 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-4b6b0e88-596d-48db-bccb-0c045cb6475e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:27.797774 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-4b6b0e88-596d-48db-bccb-0c045cb6475e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:27.804240 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4b6b0e88-596d-48db-bccb-0c045cb6475e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:27.804807 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4b6b0e88-596d-48db-bccb-0c045cb6475e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:27.805272 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4b6b0e88-596d-48db-bccb-0c045cb6475e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:27.805964 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4b6b0e88-596d-48db-bccb-0c045cb6475e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:27.806417 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4b6b0e88-596d-48db-bccb-0c045cb6475e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:27.806844 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4b6b0e88-596d-48db-bccb-0c045cb6475e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:27.941353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-4b6b0e88-596d-48db-bccb-0c045cb6475e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:27.949903 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-4b6b0e88-596d-48db-bccb-0c045cb6475e tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86" status: 200 len: 1557 microversion: 2.1 time: 0.156417 Aug 18 14:57:27.950559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 547/809] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:27 2022] GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86 => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:27.972253 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f4c0cf6b-f758-49d0-b2cf-4bcdd13a37a1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:27.972784 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f4c0cf6b-f758-49d0-b2cf-4bcdd13a37a1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:27.978975 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f4c0cf6b-f758-49d0-b2cf-4bcdd13a37a1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:27.979644 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f4c0cf6b-f758-49d0-b2cf-4bcdd13a37a1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:27.980197 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f4c0cf6b-f758-49d0-b2cf-4bcdd13a37a1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:27.980958 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f4c0cf6b-f758-49d0-b2cf-4bcdd13a37a1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:27.981483 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f4c0cf6b-f758-49d0-b2cf-4bcdd13a37a1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:27.981971 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f4c0cf6b-f758-49d0-b2cf-4bcdd13a37a1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:28.071461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f4c0cf6b-f758-49d0-b2cf-4bcdd13a37a1 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102985 Aug 18 14:57:28.072093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 548/810] 10.222.0.36 () {58 vars in 1275 bytes} [Thu Aug 18 14:57:27 2022] GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:57:28.078903 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-fdb125d5-f1f6-4eef-97e1-bc3a6c433673 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:28.078903 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-fdb125d5-f1f6-4eef-97e1-bc3a6c433673 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 26c1eb76-2063-4c0d-80a1-6c0d9baaace4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:28.084026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fdb125d5-f1f6-4eef-97e1-bc3a6c433673 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:28.084614 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fdb125d5-f1f6-4eef-97e1-bc3a6c433673 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:28.085150 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fdb125d5-f1f6-4eef-97e1-bc3a6c433673 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:28.085971 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fdb125d5-f1f6-4eef-97e1-bc3a6c433673 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:28.086524 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fdb125d5-f1f6-4eef-97e1-bc3a6c433673 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:28.087054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fdb125d5-f1f6-4eef-97e1-bc3a6c433673 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:28.355096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-fdb125d5-f1f6-4eef-97e1-bc3a6c433673 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:28.362911 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-fdb125d5-f1f6-4eef-97e1-bc3a6c433673 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4" status: 200 len: 1264 microversion: 2.1 time: 0.289856 Aug 18 14:57:28.363520 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 549/811] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:28 2022] GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4 => generated 1264 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:57:28.368490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-84284869-155b-4d26-8d10-66c8633c6661 req-fffb84b0-be81-4f06-82d1-7687c31097c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c1eb76-2063-4c0d-80a1-6c0d9baaace4", "name": "network-vif-plugged", "status": "completed", "tag": "87aea118-6682-42ff-87ca-60d074c906df"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:57:28.377613 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-84284869-155b-4d26-8d10-66c8633c6661 req-fffb84b0-be81-4f06-82d1-7687c31097c4 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:28.378093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-84284869-155b-4d26-8d10-66c8633c6661 req-fffb84b0-be81-4f06-82d1-7687c31097c4 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:28.378526 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-84284869-155b-4d26-8d10-66c8633c6661 req-fffb84b0-be81-4f06-82d1-7687c31097c4 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:28.389953 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-84284869-155b-4d26-8d10-66c8633c6661 req-fffb84b0-be81-4f06-82d1-7687c31097c4 service nova] Creating event network-vif-plugged:87aea118-6682-42ff-87ca-60d074c906df for instance 26c1eb76-2063-4c0d-80a1-6c0d9baaace4 on hv-cinder-85220 Aug 18 14:57:28.394841 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-84284869-155b-4d26-8d10-66c8633c6661 req-fffb84b0-be81-4f06-82d1-7687c31097c4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029690 Aug 18 14:57:28.395512 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 550/812] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:57:28.813763 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2024e72f-0a3e-420f-a363-87a905018859 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:28.814583 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2024e72f-0a3e-420f-a363-87a905018859 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:28.822054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2024e72f-0a3e-420f-a363-87a905018859 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:28.822872 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2024e72f-0a3e-420f-a363-87a905018859 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:28.823007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2024e72f-0a3e-420f-a363-87a905018859 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:28.823905 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2024e72f-0a3e-420f-a363-87a905018859 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:28.824134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2024e72f-0a3e-420f-a363-87a905018859 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:28.824644 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2024e72f-0a3e-420f-a363-87a905018859 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:29.049338 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2024e72f-0a3e-420f-a363-87a905018859 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:29.057676 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2024e72f-0a3e-420f-a363-87a905018859 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:29.059183 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2024e72f-0a3e-420f-a363-87a905018859 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:29.060938 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2024e72f-0a3e-420f-a363-87a905018859 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1722 microversion: 2.20 time: 0.251411 Aug 18 14:57:29.060938 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 551/813] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:28 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:57:29.222858 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-a477cf63-4f7a-4dbc-a0c6-cd8b1204775f req-d625f96d-7346-4da5-a093-6946282cd6b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b930f52-a56c-4003-b85a-bf2905b6ba86", "tag": "173256a4-b50a-40ae-8f25-84e06b5fe723"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:57:29.232573 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-a477cf63-4f7a-4dbc-a0c6-cd8b1204775f req-d625f96d-7346-4da5-a093-6946282cd6b2 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:29.233048 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-a477cf63-4f7a-4dbc-a0c6-cd8b1204775f req-d625f96d-7346-4da5-a093-6946282cd6b2 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:29.233559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-a477cf63-4f7a-4dbc-a0c6-cd8b1204775f req-d625f96d-7346-4da5-a093-6946282cd6b2 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:29.246727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-a477cf63-4f7a-4dbc-a0c6-cd8b1204775f req-d625f96d-7346-4da5-a093-6946282cd6b2 service nova] Creating event network-changed:173256a4-b50a-40ae-8f25-84e06b5fe723 for instance 3b930f52-a56c-4003-b85a-bf2905b6ba86 on hv-cinder-85220 Aug 18 14:57:29.252543 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-a477cf63-4f7a-4dbc-a0c6-cd8b1204775f req-d625f96d-7346-4da5-a093-6946282cd6b2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033344 Aug 18 14:57:29.253257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 552/814] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:57:29.385740 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e9596c65-e99b-4656-baac-f9d9784ba880 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:29.386591 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e9596c65-e99b-4656-baac-f9d9784ba880 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 26c1eb76-2063-4c0d-80a1-6c0d9baaace4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:29.393241 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e9596c65-e99b-4656-baac-f9d9784ba880 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:29.393725 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e9596c65-e99b-4656-baac-f9d9784ba880 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:29.394154 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e9596c65-e99b-4656-baac-f9d9784ba880 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:29.395538 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e9596c65-e99b-4656-baac-f9d9784ba880 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:29.396033 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e9596c65-e99b-4656-baac-f9d9784ba880 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:29.396452 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e9596c65-e99b-4656-baac-f9d9784ba880 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:29.533676 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e9596c65-e99b-4656-baac-f9d9784ba880 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:29.541539 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e9596c65-e99b-4656-baac-f9d9784ba880 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4" status: 200 len: 1264 microversion: 2.1 time: 0.160050 Aug 18 14:57:29.542088 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 553/815] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:29 2022] GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:30.084418 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e484264a-d0ac-4233-8018-fc190b1c8f94 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:30.085068 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e484264a-d0ac-4233-8018-fc190b1c8f94 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:30.091944 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e484264a-d0ac-4233-8018-fc190b1c8f94 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:30.092436 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e484264a-d0ac-4233-8018-fc190b1c8f94 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:30.092870 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e484264a-d0ac-4233-8018-fc190b1c8f94 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:30.093569 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e484264a-d0ac-4233-8018-fc190b1c8f94 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:30.094024 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e484264a-d0ac-4233-8018-fc190b1c8f94 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:30.094446 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e484264a-d0ac-4233-8018-fc190b1c8f94 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:30.234411 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e484264a-d0ac-4233-8018-fc190b1c8f94 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:30.243395 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e484264a-d0ac-4233-8018-fc190b1c8f94 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:30.245613 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e484264a-d0ac-4233-8018-fc190b1c8f94 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:30.246283 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e484264a-d0ac-4233-8018-fc190b1c8f94 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1722 microversion: 2.20 time: 0.166420 Aug 18 14:57:30.246929 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 554/816] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:30 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:57:30.562199 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-cea607ca-6e38-4486-a555-7c6636276191 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:30.562811 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-cea607ca-6e38-4486-a555-7c6636276191 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 26c1eb76-2063-4c0d-80a1-6c0d9baaace4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:30.569058 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cea607ca-6e38-4486-a555-7c6636276191 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:30.569539 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cea607ca-6e38-4486-a555-7c6636276191 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:30.569972 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cea607ca-6e38-4486-a555-7c6636276191 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:30.570663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cea607ca-6e38-4486-a555-7c6636276191 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:30.571120 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cea607ca-6e38-4486-a555-7c6636276191 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:30.571541 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cea607ca-6e38-4486-a555-7c6636276191 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:30.752517 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-cea607ca-6e38-4486-a555-7c6636276191 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:30.760842 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-cea607ca-6e38-4486-a555-7c6636276191 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4" status: 200 len: 1264 microversion: 2.1 time: 0.202475 Aug 18 14:57:30.761446 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 555/817] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:30 2022] GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4 => generated 1264 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:31.269076 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-23bdac35-5ea7-434c-85c9-095be53d7bf1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:31.269776 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-23bdac35-5ea7-434c-85c9-095be53d7bf1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:31.276251 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-23bdac35-5ea7-434c-85c9-095be53d7bf1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:31.276732 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-23bdac35-5ea7-434c-85c9-095be53d7bf1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:31.277163 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-23bdac35-5ea7-434c-85c9-095be53d7bf1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:31.277976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-23bdac35-5ea7-434c-85c9-095be53d7bf1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:31.278423 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-23bdac35-5ea7-434c-85c9-095be53d7bf1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:31.278846 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-23bdac35-5ea7-434c-85c9-095be53d7bf1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:31.408156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-23bdac35-5ea7-434c-85c9-095be53d7bf1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:31.417185 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-23bdac35-5ea7-434c-85c9-095be53d7bf1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:31.418840 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-23bdac35-5ea7-434c-85c9-095be53d7bf1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:31.420111 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-23bdac35-5ea7-434c-85c9-095be53d7bf1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1722 microversion: 2.20 time: 0.154971 Aug 18 14:57:31.420680 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 556/818] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:31 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:57:31.781702 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a69c86e5-f611-4fdc-8481-45da720b55e9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:31.782308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a69c86e5-f611-4fdc-8481-45da720b55e9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 26c1eb76-2063-4c0d-80a1-6c0d9baaace4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:31.788766 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a69c86e5-f611-4fdc-8481-45da720b55e9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:31.789247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a69c86e5-f611-4fdc-8481-45da720b55e9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:31.789678 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a69c86e5-f611-4fdc-8481-45da720b55e9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:31.790362 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a69c86e5-f611-4fdc-8481-45da720b55e9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:31.790814 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a69c86e5-f611-4fdc-8481-45da720b55e9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:31.791234 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a69c86e5-f611-4fdc-8481-45da720b55e9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:31.926260 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a69c86e5-f611-4fdc-8481-45da720b55e9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:31.934112 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a69c86e5-f611-4fdc-8481-45da720b55e9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4" status: 200 len: 1451 microversion: 2.1 time: 0.156308 Aug 18 14:57:31.934688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 557/819] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:31 2022] GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:31.953773 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-913d13b8-c9e8-47f2-88b0-757b88965988 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:31.954388 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-913d13b8-c9e8-47f2-88b0-757b88965988 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 26c1eb76-2063-4c0d-80a1-6c0d9baaace4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:31.960792 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-913d13b8-c9e8-47f2-88b0-757b88965988 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:31.961273 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-913d13b8-c9e8-47f2-88b0-757b88965988 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:31.961709 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-913d13b8-c9e8-47f2-88b0-757b88965988 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:31.962405 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-913d13b8-c9e8-47f2-88b0-757b88965988 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:31.962863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-913d13b8-c9e8-47f2-88b0-757b88965988 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:31.963289 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-913d13b8-c9e8-47f2-88b0-757b88965988 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:32.093230 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-913d13b8-c9e8-47f2-88b0-757b88965988 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:32.101789 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-913d13b8-c9e8-47f2-88b0-757b88965988 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4" status: 200 len: 1451 microversion: 2.1 time: 0.151615 Aug 18 14:57:32.102355 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 558/820] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:31 2022] GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:32.444240 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8c01455a-d33d-45db-8418-4c1c1482e5ac tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:32.444935 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-8c01455a-d33d-45db-8418-4c1c1482e5ac tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:32.451789 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8c01455a-d33d-45db-8418-4c1c1482e5ac tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:32.451962 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8c01455a-d33d-45db-8418-4c1c1482e5ac tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:32.452394 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8c01455a-d33d-45db-8418-4c1c1482e5ac tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:32.453078 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8c01455a-d33d-45db-8418-4c1c1482e5ac tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:32.453520 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8c01455a-d33d-45db-8418-4c1c1482e5ac tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:32.453938 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8c01455a-d33d-45db-8418-4c1c1482e5ac tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:32.456660 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:57:32.674994 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8c01455a-d33d-45db-8418-4c1c1482e5ac tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:32.683638 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8c01455a-d33d-45db-8418-4c1c1482e5ac tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:32.685456 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8c01455a-d33d-45db-8418-4c1c1482e5ac tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:32.686674 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-8c01455a-d33d-45db-8418-4c1c1482e5ac tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1722 microversion: 2.20 time: 0.247035 Aug 18 14:57:32.687438 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 559/821] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:32 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:57:33.710837 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2be03adf-52d7-4094-8b91-af45dc2fa2c9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:33.711488 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2be03adf-52d7-4094-8b91-af45dc2fa2c9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:33.717971 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2be03adf-52d7-4094-8b91-af45dc2fa2c9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:33.718463 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2be03adf-52d7-4094-8b91-af45dc2fa2c9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:33.718904 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2be03adf-52d7-4094-8b91-af45dc2fa2c9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:33.719617 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2be03adf-52d7-4094-8b91-af45dc2fa2c9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:33.720096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2be03adf-52d7-4094-8b91-af45dc2fa2c9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:33.720522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2be03adf-52d7-4094-8b91-af45dc2fa2c9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:33.931523 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2be03adf-52d7-4094-8b91-af45dc2fa2c9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:33.940208 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2be03adf-52d7-4094-8b91-af45dc2fa2c9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:33.941851 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2be03adf-52d7-4094-8b91-af45dc2fa2c9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:33.943018 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2be03adf-52d7-4094-8b91-af45dc2fa2c9 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1722 microversion: 2.20 time: 0.236306 Aug 18 14:57:33.943578 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 560/822] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:33 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:57:34.464362 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-c1aa082e-883d-444c-aae9-87b039ca8d81 req-cbf520d0-3976-4b7b-a109-0568045ad1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26c1eb76-2063-4c0d-80a1-6c0d9baaace4", "tag": "87aea118-6682-42ff-87ca-60d074c906df"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:57:34.474067 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-c1aa082e-883d-444c-aae9-87b039ca8d81 req-cbf520d0-3976-4b7b-a109-0568045ad1a0 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:34.475021 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-c1aa082e-883d-444c-aae9-87b039ca8d81 req-cbf520d0-3976-4b7b-a109-0568045ad1a0 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:34.475512 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-c1aa082e-883d-444c-aae9-87b039ca8d81 req-cbf520d0-3976-4b7b-a109-0568045ad1a0 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:34.487146 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-c1aa082e-883d-444c-aae9-87b039ca8d81 req-cbf520d0-3976-4b7b-a109-0568045ad1a0 service nova] Creating event network-changed:87aea118-6682-42ff-87ca-60d074c906df for instance 26c1eb76-2063-4c0d-80a1-6c0d9baaace4 on hv-cinder-85220 Aug 18 14:57:34.492519 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-c1aa082e-883d-444c-aae9-87b039ca8d81 req-cbf520d0-3976-4b7b-a109-0568045ad1a0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031794 Aug 18 14:57:34.493111 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 561/823] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:57:34.967506 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-cad4eeff-bded-417b-8511-0b59f5f6abce tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:34.968243 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-cad4eeff-bded-417b-8511-0b59f5f6abce tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:34.974452 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cad4eeff-bded-417b-8511-0b59f5f6abce tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:34.974939 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cad4eeff-bded-417b-8511-0b59f5f6abce tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:34.975585 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cad4eeff-bded-417b-8511-0b59f5f6abce tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:34.976319 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cad4eeff-bded-417b-8511-0b59f5f6abce tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:34.976777 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cad4eeff-bded-417b-8511-0b59f5f6abce tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:34.977201 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cad4eeff-bded-417b-8511-0b59f5f6abce tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:35.385623 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-cad4eeff-bded-417b-8511-0b59f5f6abce tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:35.395187 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-cad4eeff-bded-417b-8511-0b59f5f6abce tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:35.397465 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-cad4eeff-bded-417b-8511-0b59f5f6abce tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:35.398900 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-cad4eeff-bded-417b-8511-0b59f5f6abce tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1722 microversion: 2.20 time: 0.436311 Aug 18 14:57:35.399472 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 562/824] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:34 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1722 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:57:36.422656 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-53dd68e0-c5c2-4663-98db-ebe1758823c0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:36.423297 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-53dd68e0-c5c2-4663-98db-ebe1758823c0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:36.429884 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-53dd68e0-c5c2-4663-98db-ebe1758823c0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:36.430359 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-53dd68e0-c5c2-4663-98db-ebe1758823c0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:36.430784 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-53dd68e0-c5c2-4663-98db-ebe1758823c0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:36.431465 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-53dd68e0-c5c2-4663-98db-ebe1758823c0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:36.431950 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-53dd68e0-c5c2-4663-98db-ebe1758823c0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:36.432371 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-53dd68e0-c5c2-4663-98db-ebe1758823c0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:36.563551 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-53dd68e0-c5c2-4663-98db-ebe1758823c0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:36.571795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-53dd68e0-c5c2-4663-98db-ebe1758823c0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:36.573285 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-53dd68e0-c5c2-4663-98db-ebe1758823c0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:36.574453 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-53dd68e0-c5c2-4663-98db-ebe1758823c0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1722 microversion: 2.20 time: 0.155917 Aug 18 14:57:36.575004 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 563/825] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:36 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:57:37.597133 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-608989ec-c9ec-4ea3-8d8c-572081432d62 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:37.598350 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-608989ec-c9ec-4ea3-8d8c-572081432d62 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:37.604834 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-608989ec-c9ec-4ea3-8d8c-572081432d62 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:37.605313 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-608989ec-c9ec-4ea3-8d8c-572081432d62 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:37.605746 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-608989ec-c9ec-4ea3-8d8c-572081432d62 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:37.606440 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-608989ec-c9ec-4ea3-8d8c-572081432d62 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:37.606888 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-608989ec-c9ec-4ea3-8d8c-572081432d62 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:37.607311 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-608989ec-c9ec-4ea3-8d8c-572081432d62 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:37.742612 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-608989ec-c9ec-4ea3-8d8c-572081432d62 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:37.750904 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-608989ec-c9ec-4ea3-8d8c-572081432d62 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:37.752423 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-608989ec-c9ec-4ea3-8d8c-572081432d62 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:37.753586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-608989ec-c9ec-4ea3-8d8c-572081432d62 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1722 microversion: 2.20 time: 0.160448 Aug 18 14:57:37.754141 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 564/826] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:37 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:57:38.777221 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-00b90040-f930-4d68-a402-1a5ba9260f46 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:38.777896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-00b90040-f930-4d68-a402-1a5ba9260f46 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:38.784362 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-00b90040-f930-4d68-a402-1a5ba9260f46 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:38.784849 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-00b90040-f930-4d68-a402-1a5ba9260f46 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:38.785285 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-00b90040-f930-4d68-a402-1a5ba9260f46 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:38.785981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-00b90040-f930-4d68-a402-1a5ba9260f46 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:38.786441 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-00b90040-f930-4d68-a402-1a5ba9260f46 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:38.786871 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-00b90040-f930-4d68-a402-1a5ba9260f46 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:38.916999 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-00b90040-f930-4d68-a402-1a5ba9260f46 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:38.925336 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-00b90040-f930-4d68-a402-1a5ba9260f46 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:38.926892 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-00b90040-f930-4d68-a402-1a5ba9260f46 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:38.928085 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-00b90040-f930-4d68-a402-1a5ba9260f46 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1722 microversion: 2.20 time: 0.154798 Aug 18 14:57:38.928655 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 565/827] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:38 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:57:39.951119 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-1a3f7a01-2f39-4f03-bb0f-cf7fd9e1cdd0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:39.951991 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-1a3f7a01-2f39-4f03-bb0f-cf7fd9e1cdd0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:39.962455 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1a3f7a01-2f39-4f03-bb0f-cf7fd9e1cdd0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:39.962950 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1a3f7a01-2f39-4f03-bb0f-cf7fd9e1cdd0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:39.963389 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1a3f7a01-2f39-4f03-bb0f-cf7fd9e1cdd0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:39.964173 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1a3f7a01-2f39-4f03-bb0f-cf7fd9e1cdd0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:39.964706 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1a3f7a01-2f39-4f03-bb0f-cf7fd9e1cdd0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:39.965144 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1a3f7a01-2f39-4f03-bb0f-cf7fd9e1cdd0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:40.110928 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-1a3f7a01-2f39-4f03-bb0f-cf7fd9e1cdd0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:40.120645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-1a3f7a01-2f39-4f03-bb0f-cf7fd9e1cdd0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:40.122338 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-1a3f7a01-2f39-4f03-bb0f-cf7fd9e1cdd0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:40.124066 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-1a3f7a01-2f39-4f03-bb0f-cf7fd9e1cdd0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1722 microversion: 2.20 time: 0.177074 Aug 18 14:57:40.124774 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 566/828] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:39 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:57:41.150013 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2f05f0a5-2758-45aa-9299-2c442cd930f5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:41.150613 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2f05f0a5-2758-45aa-9299-2c442cd930f5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:41.157163 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2f05f0a5-2758-45aa-9299-2c442cd930f5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:41.157644 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2f05f0a5-2758-45aa-9299-2c442cd930f5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:41.158080 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2f05f0a5-2758-45aa-9299-2c442cd930f5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:41.158772 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2f05f0a5-2758-45aa-9299-2c442cd930f5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:41.159220 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2f05f0a5-2758-45aa-9299-2c442cd930f5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:41.159643 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2f05f0a5-2758-45aa-9299-2c442cd930f5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:41.289054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2f05f0a5-2758-45aa-9299-2c442cd930f5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:41.297334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2f05f0a5-2758-45aa-9299-2c442cd930f5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:41.298836 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2f05f0a5-2758-45aa-9299-2c442cd930f5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:41.300022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2f05f0a5-2758-45aa-9299-2c442cd930f5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1722 microversion: 2.20 time: 0.154816 Aug 18 14:57:41.300581 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 567/829] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:41 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:57:42.323137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0ac98e52-4937-44f0-8832-a66e3bb3c832 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:42.323868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0ac98e52-4937-44f0-8832-a66e3bb3c832 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:42.330153 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0ac98e52-4937-44f0-8832-a66e3bb3c832 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:42.330641 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0ac98e52-4937-44f0-8832-a66e3bb3c832 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:42.331068 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0ac98e52-4937-44f0-8832-a66e3bb3c832 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:42.331781 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0ac98e52-4937-44f0-8832-a66e3bb3c832 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:42.332831 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0ac98e52-4937-44f0-8832-a66e3bb3c832 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:42.333255 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0ac98e52-4937-44f0-8832-a66e3bb3c832 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:42.465164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-0ac98e52-4937-44f0-8832-a66e3bb3c832 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:42.473984 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-0ac98e52-4937-44f0-8832-a66e3bb3c832 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:42.475479 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-0ac98e52-4937-44f0-8832-a66e3bb3c832 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:42.476728 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0ac98e52-4937-44f0-8832-a66e3bb3c832 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1743 microversion: 2.20 time: 0.157555 Aug 18 14:57:42.477271 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 568/830] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:42 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:57:43.501391 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ae37f03b-54f0-48e4-aaa5-1c59599c5b4e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:43.502069 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ae37f03b-54f0-48e4-aaa5-1c59599c5b4e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:43.508673 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ae37f03b-54f0-48e4-aaa5-1c59599c5b4e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:43.509159 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ae37f03b-54f0-48e4-aaa5-1c59599c5b4e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:43.509592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ae37f03b-54f0-48e4-aaa5-1c59599c5b4e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:43.510289 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ae37f03b-54f0-48e4-aaa5-1c59599c5b4e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:43.510739 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ae37f03b-54f0-48e4-aaa5-1c59599c5b4e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:43.511160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ae37f03b-54f0-48e4-aaa5-1c59599c5b4e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:43.641939 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ae37f03b-54f0-48e4-aaa5-1c59599c5b4e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:43.650274 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ae37f03b-54f0-48e4-aaa5-1c59599c5b4e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:43.651835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ae37f03b-54f0-48e4-aaa5-1c59599c5b4e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:43.652999 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-ae37f03b-54f0-48e4-aaa5-1c59599c5b4e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1743 microversion: 2.20 time: 0.155578 Aug 18 14:57:43.653561 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 569/831] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:43 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:57:43.662609 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e905279d-877c-48ef-af8d-70e13b9944df tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:43.663107 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e905279d-877c-48ef-af8d-70e13b9944df tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:43.668977 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e905279d-877c-48ef-af8d-70e13b9944df tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:43.669469 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e905279d-877c-48ef-af8d-70e13b9944df tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:43.669935 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e905279d-877c-48ef-af8d-70e13b9944df tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:43.670632 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e905279d-877c-48ef-af8d-70e13b9944df tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:43.671090 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e905279d-877c-48ef-af8d-70e13b9944df tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:43.671518 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e905279d-877c-48ef-af8d-70e13b9944df tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:43.697461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e905279d-877c-48ef-af8d-70e13b9944df tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303/ips" status: 200 len: 146 microversion: 2.1 time: 0.038980 Aug 18 14:57:43.698238 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 570/832] 10.222.0.36 () {58 vars in 1248 bytes} [Thu Aug 18 14:57:43 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:57:44.676420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f01f18a4-1894-4d0b-88f0-d65f049c52fc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:44.677070 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f01f18a4-1894-4d0b-88f0-d65f049c52fc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:44.683773 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f01f18a4-1894-4d0b-88f0-d65f049c52fc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:44.684253 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f01f18a4-1894-4d0b-88f0-d65f049c52fc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:44.684684 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f01f18a4-1894-4d0b-88f0-d65f049c52fc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:44.685377 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f01f18a4-1894-4d0b-88f0-d65f049c52fc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:44.685830 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f01f18a4-1894-4d0b-88f0-d65f049c52fc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:44.686253 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f01f18a4-1894-4d0b-88f0-d65f049c52fc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:44.814053 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f01f18a4-1894-4d0b-88f0-d65f049c52fc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:44.822290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f01f18a4-1894-4d0b-88f0-d65f049c52fc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:44.823825 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f01f18a4-1894-4d0b-88f0-d65f049c52fc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:44.825003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f01f18a4-1894-4d0b-88f0-d65f049c52fc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1743 microversion: 2.20 time: 0.152598 Aug 18 14:57:44.825555 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 571/833] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:44 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:57:45.021727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-06abca90-a985-462b-baa0-ea0f9d3e59e8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f1171ef-c9ed-4323-8c52-bd1638e607b2"}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:57:45.024197 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-06abca90-a985-462b-baa0-ea0f9d3e59e8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:45.030238 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-06abca90-a985-462b-baa0-ea0f9d3e59e8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:45.030731 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-06abca90-a985-462b-baa0-ea0f9d3e59e8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:45.031168 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-06abca90-a985-462b-baa0-ea0f9d3e59e8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:45.031925 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-06abca90-a985-462b-baa0-ea0f9d3e59e8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:45.032356 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-06abca90-a985-462b-baa0-ea0f9d3e59e8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:45.032781 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-06abca90-a985-462b-baa0-ea0f9d3e59e8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:45.317960 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-06abca90-a985-462b-baa0-ea0f9d3e59e8 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "POST /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300792 Aug 18 14:57:45.318562 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 572/834] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Aug 18 14:57:45 2022] POST /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:57:45.850200 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-57ec40d2-c3a7-4dd0-90b3-c505b4987e85 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:45.851023 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-57ec40d2-c3a7-4dd0-90b3-c505b4987e85 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:45.857358 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57ec40d2-c3a7-4dd0-90b3-c505b4987e85 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:45.857846 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57ec40d2-c3a7-4dd0-90b3-c505b4987e85 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:45.858310 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57ec40d2-c3a7-4dd0-90b3-c505b4987e85 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:45.859223 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57ec40d2-c3a7-4dd0-90b3-c505b4987e85 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:45.859872 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57ec40d2-c3a7-4dd0-90b3-c505b4987e85 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:45.860345 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57ec40d2-c3a7-4dd0-90b3-c505b4987e85 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:46.025611 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-57ec40d2-c3a7-4dd0-90b3-c505b4987e85 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:46.037527 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-57ec40d2-c3a7-4dd0-90b3-c505b4987e85 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:46.039967 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-57ec40d2-c3a7-4dd0-90b3-c505b4987e85 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:46.041735 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-57ec40d2-c3a7-4dd0-90b3-c505b4987e85 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1738 microversion: 2.20 time: 0.196740 Aug 18 14:57:46.042829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 573/835] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:45 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:57:46.138611 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-bfa7df06-459a-43d8-a333-e6a289d5c73f req-0a3f32fe-aeb1-4bcc-9c15-53d491e68fec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cb0c027-abae-485d-a0b8-c57e5286d2b1", "name": "network-vif-plugged", "status": "completed", "tag": "982d1ea2-1757-4ef9-9f00-9c88adcab716"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:57:46.158988 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-bfa7df06-459a-43d8-a333-e6a289d5c73f req-0a3f32fe-aeb1-4bcc-9c15-53d491e68fec service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:46.159761 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-bfa7df06-459a-43d8-a333-e6a289d5c73f req-0a3f32fe-aeb1-4bcc-9c15-53d491e68fec service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:46.160394 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-bfa7df06-459a-43d8-a333-e6a289d5c73f req-0a3f32fe-aeb1-4bcc-9c15-53d491e68fec service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:46.174774 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-bfa7df06-459a-43d8-a333-e6a289d5c73f req-0a3f32fe-aeb1-4bcc-9c15-53d491e68fec service nova] Creating event network-vif-plugged:982d1ea2-1757-4ef9-9f00-9c88adcab716 for instance 1cb0c027-abae-485d-a0b8-c57e5286d2b1 on hv-cinder-85220 Aug 18 14:57:46.180970 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-bfa7df06-459a-43d8-a333-e6a289d5c73f req-0a3f32fe-aeb1-4bcc-9c15-53d491e68fec service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048709 Aug 18 14:57:46.181920 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 574/836] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:57:47.068934 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c8b78596-fe11-4dc0-ba8d-2a22e747d595 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:47.070548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c8b78596-fe11-4dc0-ba8d-2a22e747d595 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:47.081385 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c8b78596-fe11-4dc0-ba8d-2a22e747d595 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:47.083137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c8b78596-fe11-4dc0-ba8d-2a22e747d595 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:47.084205 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c8b78596-fe11-4dc0-ba8d-2a22e747d595 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:47.085538 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c8b78596-fe11-4dc0-ba8d-2a22e747d595 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:47.086617 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c8b78596-fe11-4dc0-ba8d-2a22e747d595 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:47.087331 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c8b78596-fe11-4dc0-ba8d-2a22e747d595 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:47.267626 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c8b78596-fe11-4dc0-ba8d-2a22e747d595 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:47.279552 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c8b78596-fe11-4dc0-ba8d-2a22e747d595 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:47.281372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c8b78596-fe11-4dc0-ba8d-2a22e747d595 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:47.282761 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c8b78596-fe11-4dc0-ba8d-2a22e747d595 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1738 microversion: 2.20 time: 0.219978 Aug 18 14:57:47.283479 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 575/837] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:47 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:57:47.834647 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-bedbb371-2d01-4798-b9af-20d345f4ace1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:47.835274 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-bedbb371-2d01-4798-b9af-20d345f4ace1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:47.844392 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bedbb371-2d01-4798-b9af-20d345f4ace1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:47.845261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bedbb371-2d01-4798-b9af-20d345f4ace1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:47.846202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bedbb371-2d01-4798-b9af-20d345f4ace1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:47.847184 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bedbb371-2d01-4798-b9af-20d345f4ace1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:47.848065 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bedbb371-2d01-4798-b9af-20d345f4ace1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:47.848792 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bedbb371-2d01-4798-b9af-20d345f4ace1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:47.852086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:57:47.958515 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.objects.instance [None req-bedbb371-2d01-4798-b9af-20d345f4ace1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lazy-loading 'services' on Instance uuid d9163961-387b-4e9b-94a8-9647dde7c208 {{(pid=132268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:57:48.055279 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-bedbb371-2d01-4798-b9af-20d345f4ace1 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/os-volume_attachments/dc24f99d-2752-4fc1-afee-621294774608" status: 202 len: 0 microversion: 2.1 time: 0.225431 Aug 18 14:57:48.057110 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 576/838] 10.222.0.36 () {58 vars in 1416 bytes} [Thu Aug 18 14:57:47 2022] DELETE /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/os-volume_attachments/dc24f99d-2752-4fc1-afee-621294774608 => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 14:57:48.068248 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3c7127b4-fd6c-49f5-b88d-f4b518404d0a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:48.070811 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-3c7127b4-fd6c-49f5-b88d-f4b518404d0a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:48.078301 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3c7127b4-fd6c-49f5-b88d-f4b518404d0a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:48.078939 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3c7127b4-fd6c-49f5-b88d-f4b518404d0a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:48.079709 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3c7127b4-fd6c-49f5-b88d-f4b518404d0a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:48.080937 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3c7127b4-fd6c-49f5-b88d-f4b518404d0a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:48.081640 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3c7127b4-fd6c-49f5-b88d-f4b518404d0a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:48.082314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3c7127b4-fd6c-49f5-b88d-f4b518404d0a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:48.119609 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-3c7127b4-fd6c-49f5-b88d-f4b518404d0a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056725 Aug 18 14:57:48.120769 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 577/839] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Aug 18 14:57:48 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:57:48.307422 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-474536d5-f118-4f7a-bf27-2ffdd06277e4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:48.307983 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-474536d5-f118-4f7a-bf27-2ffdd06277e4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:48.314596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-474536d5-f118-4f7a-bf27-2ffdd06277e4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:48.315088 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-474536d5-f118-4f7a-bf27-2ffdd06277e4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:48.315521 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-474536d5-f118-4f7a-bf27-2ffdd06277e4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:48.316967 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-474536d5-f118-4f7a-bf27-2ffdd06277e4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:48.317432 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-474536d5-f118-4f7a-bf27-2ffdd06277e4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:48.317861 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-474536d5-f118-4f7a-bf27-2ffdd06277e4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:48.483534 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-474536d5-f118-4f7a-bf27-2ffdd06277e4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:48.493297 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-474536d5-f118-4f7a-bf27-2ffdd06277e4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:48.495145 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-474536d5-f118-4f7a-bf27-2ffdd06277e4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:48.496804 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-474536d5-f118-4f7a-bf27-2ffdd06277e4 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1738 microversion: 2.20 time: 0.193514 Aug 18 14:57:48.497363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 578/840] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:48 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:57:49.133108 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c2209c30-c4a5-424f-9aca-c8111066f7ca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:49.135745 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c2209c30-c4a5-424f-9aca-c8111066f7ca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:49.143520 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c2209c30-c4a5-424f-9aca-c8111066f7ca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:49.144742 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c2209c30-c4a5-424f-9aca-c8111066f7ca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:49.145428 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c2209c30-c4a5-424f-9aca-c8111066f7ca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:49.146346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c2209c30-c4a5-424f-9aca-c8111066f7ca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:49.146910 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c2209c30-c4a5-424f-9aca-c8111066f7ca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:49.147443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c2209c30-c4a5-424f-9aca-c8111066f7ca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:49.181963 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c2209c30-c4a5-424f-9aca-c8111066f7ca tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053332 Aug 18 14:57:49.182699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 579/841] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Aug 18 14:57:49 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:57:49.522118 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-45ec3b25-94f2-4966-aa0c-8a5b6cb0bb38 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:49.522865 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-45ec3b25-94f2-4966-aa0c-8a5b6cb0bb38 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:49.529238 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-45ec3b25-94f2-4966-aa0c-8a5b6cb0bb38 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:49.530043 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-45ec3b25-94f2-4966-aa0c-8a5b6cb0bb38 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:49.530741 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-45ec3b25-94f2-4966-aa0c-8a5b6cb0bb38 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:49.531507 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-45ec3b25-94f2-4966-aa0c-8a5b6cb0bb38 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:49.532097 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-45ec3b25-94f2-4966-aa0c-8a5b6cb0bb38 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:49.532623 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-45ec3b25-94f2-4966-aa0c-8a5b6cb0bb38 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:49.707545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-45ec3b25-94f2-4966-aa0c-8a5b6cb0bb38 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:49.718544 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-45ec3b25-94f2-4966-aa0c-8a5b6cb0bb38 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:49.720913 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-45ec3b25-94f2-4966-aa0c-8a5b6cb0bb38 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:49.722457 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-45ec3b25-94f2-4966-aa0c-8a5b6cb0bb38 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1738 microversion: 2.20 time: 0.205021 Aug 18 14:57:49.735993 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 580/842] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:49 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:57:50.194646 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-9f49429b-2b07-4003-ba6b-fa1b3fadbc41 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:50.197094 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-9f49429b-2b07-4003-ba6b-fa1b3fadbc41 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:50.204396 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9f49429b-2b07-4003-ba6b-fa1b3fadbc41 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:50.204896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9f49429b-2b07-4003-ba6b-fa1b3fadbc41 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:50.205332 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9f49429b-2b07-4003-ba6b-fa1b3fadbc41 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:50.206047 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9f49429b-2b07-4003-ba6b-fa1b3fadbc41 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:50.206505 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9f49429b-2b07-4003-ba6b-fa1b3fadbc41 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:50.207429 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9f49429b-2b07-4003-ba6b-fa1b3fadbc41 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:50.244243 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-9f49429b-2b07-4003-ba6b-fa1b3fadbc41 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053879 Aug 18 14:57:50.245466 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 581/843] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Aug 18 14:57:50 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:57:50.749201 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-6273755c-2628-4f76-8407-818b714ba52b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:50.750581 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-6273755c-2628-4f76-8407-818b714ba52b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:50.759742 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6273755c-2628-4f76-8407-818b714ba52b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:50.760397 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6273755c-2628-4f76-8407-818b714ba52b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:50.760940 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6273755c-2628-4f76-8407-818b714ba52b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:50.761879 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6273755c-2628-4f76-8407-818b714ba52b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:50.762834 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6273755c-2628-4f76-8407-818b714ba52b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:50.763489 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6273755c-2628-4f76-8407-818b714ba52b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:50.917440 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6273755c-2628-4f76-8407-818b714ba52b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:50.929183 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6273755c-2628-4f76-8407-818b714ba52b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:50.930968 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6273755c-2628-4f76-8407-818b714ba52b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:50.932178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-6273755c-2628-4f76-8407-818b714ba52b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1738 microversion: 2.20 time: 0.189785 Aug 18 14:57:50.936030 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 582/844] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:50 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:57:51.257666 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-9ab178f6-2176-4b57-a9b4-e853888e4c2d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:51.260459 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-9ab178f6-2176-4b57-a9b4-e853888e4c2d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:51.268033 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9ab178f6-2176-4b57-a9b4-e853888e4c2d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:51.268631 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9ab178f6-2176-4b57-a9b4-e853888e4c2d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:51.269186 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9ab178f6-2176-4b57-a9b4-e853888e4c2d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:51.270545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9ab178f6-2176-4b57-a9b4-e853888e4c2d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:51.271012 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9ab178f6-2176-4b57-a9b4-e853888e4c2d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:51.271443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9ab178f6-2176-4b57-a9b4-e853888e4c2d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:51.305575 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-9ab178f6-2176-4b57-a9b4-e853888e4c2d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052648 Aug 18 14:57:51.306177 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 583/845] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Aug 18 14:57:51 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:57:51.955648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-84978565-bb05-4067-854e-671a85b9422e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:51.956449 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-84978565-bb05-4067-854e-671a85b9422e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:51.967509 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-84978565-bb05-4067-854e-671a85b9422e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:51.968944 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-84978565-bb05-4067-854e-671a85b9422e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:51.969942 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-84978565-bb05-4067-854e-671a85b9422e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:51.971351 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-84978565-bb05-4067-854e-671a85b9422e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:51.972193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-84978565-bb05-4067-854e-671a85b9422e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:51.973314 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-84978565-bb05-4067-854e-671a85b9422e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:52.131862 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-84978565-bb05-4067-854e-671a85b9422e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:52.141086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-84978565-bb05-4067-854e-671a85b9422e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:52.142927 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-84978565-bb05-4067-854e-671a85b9422e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:52.145390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-84978565-bb05-4067-854e-671a85b9422e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1738 microversion: 2.20 time: 0.193705 Aug 18 14:57:52.146143 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 584/846] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:51 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:57:52.318560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a0ebc339-48ed-4dfe-882a-b580f0210e39 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:52.321006 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a0ebc339-48ed-4dfe-882a-b580f0210e39 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:52.329943 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a0ebc339-48ed-4dfe-882a-b580f0210e39 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:52.330695 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a0ebc339-48ed-4dfe-882a-b580f0210e39 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:52.331066 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a0ebc339-48ed-4dfe-882a-b580f0210e39 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:52.332522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a0ebc339-48ed-4dfe-882a-b580f0210e39 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:52.333085 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a0ebc339-48ed-4dfe-882a-b580f0210e39 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:52.333544 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a0ebc339-48ed-4dfe-882a-b580f0210e39 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:52.382107 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a0ebc339-48ed-4dfe-882a-b580f0210e39 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067579 Aug 18 14:57:52.386935 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 585/847] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Aug 18 14:57:52 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:57:52.953911 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-691c81ca-6436-42a9-89b6-37b3588f4831 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:52.957676 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-691c81ca-6436-42a9-89b6-37b3588f4831 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:52.965029 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-691c81ca-6436-42a9-89b6-37b3588f4831 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:52.965517 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-691c81ca-6436-42a9-89b6-37b3588f4831 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:52.965949 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-691c81ca-6436-42a9-89b6-37b3588f4831 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:52.966649 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-691c81ca-6436-42a9-89b6-37b3588f4831 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:52.967102 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-691c81ca-6436-42a9-89b6-37b3588f4831 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:52.967521 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-691c81ca-6436-42a9-89b6-37b3588f4831 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:53.003577 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-691c81ca-6436-42a9-89b6-37b3588f4831 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053156 Aug 18 14:57:53.009305 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 586/848] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Aug 18 14:57:52 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:57:53.014916 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-75078d96-464c-42fc-bd7a-c85a520b2e44 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:53.015735 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-75078d96-464c-42fc-bd7a-c85a520b2e44 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:53.022611 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-75078d96-464c-42fc-bd7a-c85a520b2e44 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:53.023821 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-75078d96-464c-42fc-bd7a-c85a520b2e44 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:53.023821 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-75078d96-464c-42fc-bd7a-c85a520b2e44 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:53.024338 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-75078d96-464c-42fc-bd7a-c85a520b2e44 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:53.024753 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-75078d96-464c-42fc-bd7a-c85a520b2e44 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:53.025173 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-75078d96-464c-42fc-bd7a-c85a520b2e44 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:53.060661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-75078d96-464c-42fc-bd7a-c85a520b2e44 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303/os-volume_attachments/6f1171ef-c9ed-4323-8c52-bd1638e607b2" status: 200 len: 194 microversion: 2.1 time: 0.049981 Aug 18 14:57:53.061740 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 587/849] 10.222.0.36 () {58 vars in 1413 bytes} [Thu Aug 18 14:57:53 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303/os-volume_attachments/6f1171ef-c9ed-4323-8c52-bd1638e607b2 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:57:53.170242 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-1c3b4c0b-918b-4497-b9e8-68a274e31a34 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:53.171596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-1c3b4c0b-918b-4497-b9e8-68a274e31a34 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:53.181404 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1c3b4c0b-918b-4497-b9e8-68a274e31a34 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:53.182476 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1c3b4c0b-918b-4497-b9e8-68a274e31a34 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:53.183255 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1c3b4c0b-918b-4497-b9e8-68a274e31a34 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:53.184409 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1c3b4c0b-918b-4497-b9e8-68a274e31a34 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:53.185062 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1c3b4c0b-918b-4497-b9e8-68a274e31a34 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:53.186255 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1c3b4c0b-918b-4497-b9e8-68a274e31a34 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:53.372309 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-1c3b4c0b-918b-4497-b9e8-68a274e31a34 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:53.384196 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-1c3b4c0b-918b-4497-b9e8-68a274e31a34 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:53.390368 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-1c3b4c0b-918b-4497-b9e8-68a274e31a34 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:53.391795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-1c3b4c0b-918b-4497-b9e8-68a274e31a34 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1738 microversion: 2.20 time: 0.227325 Aug 18 14:57:53.398308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 588/850] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:53 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1738 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:57:53.406351 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-de870660-fadd-430e-aec6-96042ee22389 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:53.408585 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-de870660-fadd-430e-aec6-96042ee22389 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:53.416778 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-de870660-fadd-430e-aec6-96042ee22389 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:53.417273 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-de870660-fadd-430e-aec6-96042ee22389 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:53.417715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-de870660-fadd-430e-aec6-96042ee22389 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:53.418484 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-de870660-fadd-430e-aec6-96042ee22389 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:53.419012 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-de870660-fadd-430e-aec6-96042ee22389 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:53.419443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-de870660-fadd-430e-aec6-96042ee22389 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:53.482329 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-de870660-fadd-430e-aec6-96042ee22389 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081251 Aug 18 14:57:53.482907 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 589/851] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Aug 18 14:57:53 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:57:54.420876 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-57889acc-e61c-458c-b46b-194805a843a0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:54.422833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-57889acc-e61c-458c-b46b-194805a843a0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:54.449747 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57889acc-e61c-458c-b46b-194805a843a0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:54.450591 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57889acc-e61c-458c-b46b-194805a843a0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:54.453473 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57889acc-e61c-458c-b46b-194805a843a0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:54.454537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57889acc-e61c-458c-b46b-194805a843a0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:54.455229 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57889acc-e61c-458c-b46b-194805a843a0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:54.458628 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-57889acc-e61c-458c-b46b-194805a843a0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:54.649575 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-57889acc-e61c-458c-b46b-194805a843a0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:54.658305 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-57889acc-e61c-458c-b46b-194805a843a0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:54.660308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-57889acc-e61c-458c-b46b-194805a843a0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:54.661601 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-57889acc-e61c-458c-b46b-194805a843a0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1738 microversion: 2.20 time: 0.244737 Aug 18 14:57:54.663403 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 590/852] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:54 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1738 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:57:54.668420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-44d6fdee-9048-4584-8c19-9181f8345bd2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:54.670868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-44d6fdee-9048-4584-8c19-9181f8345bd2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:54.677876 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-44d6fdee-9048-4584-8c19-9181f8345bd2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:54.678598 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-44d6fdee-9048-4584-8c19-9181f8345bd2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:54.679249 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-44d6fdee-9048-4584-8c19-9181f8345bd2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:54.680235 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-44d6fdee-9048-4584-8c19-9181f8345bd2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:54.680770 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-44d6fdee-9048-4584-8c19-9181f8345bd2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:54.681273 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-44d6fdee-9048-4584-8c19-9181f8345bd2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:54.713778 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-44d6fdee-9048-4584-8c19-9181f8345bd2 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049003 Aug 18 14:57:54.714588 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 591/853] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Aug 18 14:57:54 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 14:57:54.721917 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8fbe9bcf-953c-48e0-a993-bb609c0e60b2 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "923c5fd2-4932-468b-9ebe-1d1586d8168e"}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:57:54.724125 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-8fbe9bcf-953c-48e0-a993-bb609c0e60b2 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:54.730631 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8fbe9bcf-953c-48e0-a993-bb609c0e60b2 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:54.730991 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8fbe9bcf-953c-48e0-a993-bb609c0e60b2 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:54.731850 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8fbe9bcf-953c-48e0-a993-bb609c0e60b2 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:54.734563 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8fbe9bcf-953c-48e0-a993-bb609c0e60b2 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:54.735050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8fbe9bcf-953c-48e0-a993-bb609c0e60b2 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:54.736058 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8fbe9bcf-953c-48e0-a993-bb609c0e60b2 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:54.740790 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:57:55.095836 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-8fbe9bcf-953c-48e0-a993-bb609c0e60b2 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "POST /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.379230 Aug 18 14:57:55.096471 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 592/854] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Aug 18 14:57:54 2022] POST /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303/os-volume_attachments => generated 194 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:57:55.101982 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-053eba6c-731b-4f7f-ba90-113d410091d9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:55.102585 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-053eba6c-731b-4f7f-ba90-113d410091d9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:55.109344 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-053eba6c-731b-4f7f-ba90-113d410091d9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:55.109797 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-053eba6c-731b-4f7f-ba90-113d410091d9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:55.110154 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-053eba6c-731b-4f7f-ba90-113d410091d9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:55.110871 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-053eba6c-731b-4f7f-ba90-113d410091d9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:55.111333 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-053eba6c-731b-4f7f-ba90-113d410091d9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:55.111890 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-053eba6c-731b-4f7f-ba90-113d410091d9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:55.141046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-053eba6c-731b-4f7f-ba90-113d410091d9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Going to try to terminate instance {{(pid=132268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:57:55.211285 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=100 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:57:55.221370 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-053eba6c-731b-4f7f-ba90-113d410091d9 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 204 len: 0 microversion: 2.1 time: 0.123543 Aug 18 14:57:55.221934 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 593/855] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 14:57:55 2022] DELETE /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:57:55.231093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b670de6a-f2f9-4b03-8382-9dfaf1cac247 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:55.231822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b670de6a-f2f9-4b03-8382-9dfaf1cac247 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:55.237643 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b670de6a-f2f9-4b03-8382-9dfaf1cac247 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:55.238145 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b670de6a-f2f9-4b03-8382-9dfaf1cac247 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:55.238575 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b670de6a-f2f9-4b03-8382-9dfaf1cac247 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:55.239254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b670de6a-f2f9-4b03-8382-9dfaf1cac247 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:55.239743 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b670de6a-f2f9-4b03-8382-9dfaf1cac247 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:55.240145 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b670de6a-f2f9-4b03-8382-9dfaf1cac247 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:55.372905 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b670de6a-f2f9-4b03-8382-9dfaf1cac247 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:55.381028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b670de6a-f2f9-4b03-8382-9dfaf1cac247 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1689 microversion: 2.1 time: 0.153816 Aug 18 14:57:55.381597 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 594/856] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:55 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:55.685785 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2f656c24-64ae-44d5-82b8-abace1c35e17 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:55.686553 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2f656c24-64ae-44d5-82b8-abace1c35e17 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:55.693425 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2f656c24-64ae-44d5-82b8-abace1c35e17 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:55.693918 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2f656c24-64ae-44d5-82b8-abace1c35e17 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:55.694381 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2f656c24-64ae-44d5-82b8-abace1c35e17 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:55.695081 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2f656c24-64ae-44d5-82b8-abace1c35e17 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:55.695538 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2f656c24-64ae-44d5-82b8-abace1c35e17 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:55.696001 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2f656c24-64ae-44d5-82b8-abace1c35e17 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:55.825930 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2f656c24-64ae-44d5-82b8-abace1c35e17 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:55.834782 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2f656c24-64ae-44d5-82b8-abace1c35e17 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:55.836322 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2f656c24-64ae-44d5-82b8-abace1c35e17 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:55.837500 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2f656c24-64ae-44d5-82b8-abace1c35e17 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1738 microversion: 2.20 time: 0.155664 Aug 18 14:57:55.838063 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 595/857] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:55 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:57:56.402114 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2c13f4bc-5c74-44e5-bd56-972c5d5add2a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:56.402642 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2c13f4bc-5c74-44e5-bd56-972c5d5add2a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:56.409085 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2c13f4bc-5c74-44e5-bd56-972c5d5add2a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:56.409561 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2c13f4bc-5c74-44e5-bd56-972c5d5add2a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:56.410484 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2c13f4bc-5c74-44e5-bd56-972c5d5add2a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:56.411165 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2c13f4bc-5c74-44e5-bd56-972c5d5add2a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:56.411607 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2c13f4bc-5c74-44e5-bd56-972c5d5add2a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:56.412046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2c13f4bc-5c74-44e5-bd56-972c5d5add2a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:56.548409 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2c13f4bc-5c74-44e5-bd56-972c5d5add2a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:56.556604 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2c13f4bc-5c74-44e5-bd56-972c5d5add2a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1689 microversion: 2.1 time: 0.158494 Aug 18 14:57:56.557165 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 596/858] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:56 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:56.860196 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a4846143-2285-4064-8c22-0c75120c7296 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:56.860915 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a4846143-2285-4064-8c22-0c75120c7296 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:56.866960 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a4846143-2285-4064-8c22-0c75120c7296 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:56.867444 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a4846143-2285-4064-8c22-0c75120c7296 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:56.867911 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a4846143-2285-4064-8c22-0c75120c7296 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:56.868656 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a4846143-2285-4064-8c22-0c75120c7296 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:56.869248 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a4846143-2285-4064-8c22-0c75120c7296 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:56.870041 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a4846143-2285-4064-8c22-0c75120c7296 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:57.000584 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a4846143-2285-4064-8c22-0c75120c7296 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:57.009294 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a4846143-2285-4064-8c22-0c75120c7296 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:57.010787 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a4846143-2285-4064-8c22-0c75120c7296 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:57.011979 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a4846143-2285-4064-8c22-0c75120c7296 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1738 microversion: 2.20 time: 0.155663 Aug 18 14:57:57.012788 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 597/859] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:56 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:57:57.577409 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d451a334-86bf-4148-b3cf-9b004a31502c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:57.577937 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d451a334-86bf-4148-b3cf-9b004a31502c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:57.585290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d451a334-86bf-4148-b3cf-9b004a31502c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:57.585769 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d451a334-86bf-4148-b3cf-9b004a31502c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:57.586204 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d451a334-86bf-4148-b3cf-9b004a31502c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:57.586891 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d451a334-86bf-4148-b3cf-9b004a31502c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:57.587345 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d451a334-86bf-4148-b3cf-9b004a31502c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:57.587801 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d451a334-86bf-4148-b3cf-9b004a31502c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:57.721112 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d451a334-86bf-4148-b3cf-9b004a31502c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:57.729485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d451a334-86bf-4148-b3cf-9b004a31502c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1689 microversion: 2.1 time: 0.156077 Aug 18 14:57:57.730047 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 598/860] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:57 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:58.035422 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-9a83f24b-aa4e-4349-b61a-34dc533bf1c1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:58.036128 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-9a83f24b-aa4e-4349-b61a-34dc533bf1c1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:58.042126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9a83f24b-aa4e-4349-b61a-34dc533bf1c1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:58.042613 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9a83f24b-aa4e-4349-b61a-34dc533bf1c1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:58.043076 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9a83f24b-aa4e-4349-b61a-34dc533bf1c1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:58.043791 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9a83f24b-aa4e-4349-b61a-34dc533bf1c1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:58.044247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9a83f24b-aa4e-4349-b61a-34dc533bf1c1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:58.044677 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9a83f24b-aa4e-4349-b61a-34dc533bf1c1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:58.194204 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-9a83f24b-aa4e-4349-b61a-34dc533bf1c1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:58.202646 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-9a83f24b-aa4e-4349-b61a-34dc533bf1c1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:58.204263 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-9a83f24b-aa4e-4349-b61a-34dc533bf1c1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:58.205344 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-9a83f24b-aa4e-4349-b61a-34dc533bf1c1 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1738 microversion: 2.20 time: 0.174002 Aug 18 14:57:58.205898 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 599/861] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:58 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:57:58.210626 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-fac5a954-1a8c-40e5-bd73-df576979cae7 req-754046fc-23da-4eb4-a2db-0f665c854231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cb0c027-abae-485d-a0b8-c57e5286d2b1", "name": "network-vif-unplugged", "status": "completed", "tag": "982d1ea2-1757-4ef9-9f00-9c88adcab716"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:57:58.220091 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-fac5a954-1a8c-40e5-bd73-df576979cae7 req-754046fc-23da-4eb4-a2db-0f665c854231 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:58.220578 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-fac5a954-1a8c-40e5-bd73-df576979cae7 req-754046fc-23da-4eb4-a2db-0f665c854231 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:58.221006 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-fac5a954-1a8c-40e5-bd73-df576979cae7 req-754046fc-23da-4eb4-a2db-0f665c854231 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:58.232176 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-fac5a954-1a8c-40e5-bd73-df576979cae7 req-754046fc-23da-4eb4-a2db-0f665c854231 service nova] Creating event network-vif-unplugged:982d1ea2-1757-4ef9-9f00-9c88adcab716 for instance 1cb0c027-abae-485d-a0b8-c57e5286d2b1 on hv-cinder-85220 Aug 18 14:57:58.237362 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-fac5a954-1a8c-40e5-bd73-df576979cae7 req-754046fc-23da-4eb4-a2db-0f665c854231 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030327 Aug 18 14:57:58.238591 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 600/862] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:57:58.750795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-96203f72-f488-4bfc-825a-11afa1ba9788 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:58.751500 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-96203f72-f488-4bfc-825a-11afa1ba9788 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:58.758741 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-96203f72-f488-4bfc-825a-11afa1ba9788 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:58.759204 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-96203f72-f488-4bfc-825a-11afa1ba9788 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:58.759659 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-96203f72-f488-4bfc-825a-11afa1ba9788 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:58.760375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-96203f72-f488-4bfc-825a-11afa1ba9788 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:58.760831 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-96203f72-f488-4bfc-825a-11afa1ba9788 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:58.761254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-96203f72-f488-4bfc-825a-11afa1ba9788 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:58.895070 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-96203f72-f488-4bfc-825a-11afa1ba9788 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:58.903005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-96203f72-f488-4bfc-825a-11afa1ba9788 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1689 microversion: 2.1 time: 0.156383 Aug 18 14:57:58.903578 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 601/863] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:58 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:57:59.232208 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c2a7c4d9-f89a-4817-9e8c-26afc7229774 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:59.232845 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c2a7c4d9-f89a-4817-9e8c-26afc7229774 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:59.238917 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c2a7c4d9-f89a-4817-9e8c-26afc7229774 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:59.239388 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c2a7c4d9-f89a-4817-9e8c-26afc7229774 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:59.239857 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c2a7c4d9-f89a-4817-9e8c-26afc7229774 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:59.240557 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c2a7c4d9-f89a-4817-9e8c-26afc7229774 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:59.241015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c2a7c4d9-f89a-4817-9e8c-26afc7229774 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:59.241443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c2a7c4d9-f89a-4817-9e8c-26afc7229774 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:59.378931 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c2a7c4d9-f89a-4817-9e8c-26afc7229774 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:59.387977 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c2a7c4d9-f89a-4817-9e8c-26afc7229774 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:59.389589 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c2a7c4d9-f89a-4817-9e8c-26afc7229774 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:57:59.390788 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c2a7c4d9-f89a-4817-9e8c-26afc7229774 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1720 microversion: 2.20 time: 0.162651 Aug 18 14:57:59.391423 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 602/864] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:57:59 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:57:59.924199 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-33d40a64-2378-41bb-97c1-255cce9e5633 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:57:59.925190 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-33d40a64-2378-41bb-97c1-255cce9e5633 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:57:59.932344 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-33d40a64-2378-41bb-97c1-255cce9e5633 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:59.932831 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-33d40a64-2378-41bb-97c1-255cce9e5633 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:59.933266 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-33d40a64-2378-41bb-97c1-255cce9e5633 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:57:59.933970 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-33d40a64-2378-41bb-97c1-255cce9e5633 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:57:59.934425 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-33d40a64-2378-41bb-97c1-255cce9e5633 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:57:59.934850 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-33d40a64-2378-41bb-97c1-255cce9e5633 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:00.353295 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-33d40a64-2378-41bb-97c1-255cce9e5633 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:00.361831 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-33d40a64-2378-41bb-97c1-255cce9e5633 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1689 microversion: 2.1 time: 0.441172 Aug 18 14:58:00.361831 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 603/865] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:57:59 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1689 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:58:00.414578 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c67c3c1c-d52a-4177-983f-f96cab26a7cb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:00.415452 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c67c3c1c-d52a-4177-983f-f96cab26a7cb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:00.421801 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c67c3c1c-d52a-4177-983f-f96cab26a7cb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:00.422367 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c67c3c1c-d52a-4177-983f-f96cab26a7cb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:00.422915 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c67c3c1c-d52a-4177-983f-f96cab26a7cb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:00.423703 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c67c3c1c-d52a-4177-983f-f96cab26a7cb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:00.424290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c67c3c1c-d52a-4177-983f-f96cab26a7cb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:00.424897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c67c3c1c-d52a-4177-983f-f96cab26a7cb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:00.619807 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c67c3c1c-d52a-4177-983f-f96cab26a7cb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:00.628051 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c67c3c1c-d52a-4177-983f-f96cab26a7cb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:00.629593 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c67c3c1c-d52a-4177-983f-f96cab26a7cb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:00.630762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c67c3c1c-d52a-4177-983f-f96cab26a7cb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1720 microversion: 2.20 time: 0.220816 Aug 18 14:58:00.631325 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 604/866] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:58:00 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1720 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:58:00.971128 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-a022da74-1a01-47e7-bcc2-e44f4262f186 req-2113897d-c586-4020-9431-fc3a894d7002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9163961-387b-4e9b-94a8-9647dde7c208", "name": "network-vif-deleted", "tag": "e57de99a-4074-41f9-9a26-248196b630ba"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:58:00.980876 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-a022da74-1a01-47e7-bcc2-e44f4262f186 req-2113897d-c586-4020-9431-fc3a894d7002 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:00.981356 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-a022da74-1a01-47e7-bcc2-e44f4262f186 req-2113897d-c586-4020-9431-fc3a894d7002 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:00.981828 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-a022da74-1a01-47e7-bcc2-e44f4262f186 req-2113897d-c586-4020-9431-fc3a894d7002 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:00.992847 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-a022da74-1a01-47e7-bcc2-e44f4262f186 req-2113897d-c586-4020-9431-fc3a894d7002 service nova] Creating event network-vif-deleted:e57de99a-4074-41f9-9a26-248196b630ba for instance d9163961-387b-4e9b-94a8-9647dde7c208 on hv-cinder-85220 Aug 18 14:58:00.997736 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-a022da74-1a01-47e7-bcc2-e44f4262f186 req-2113897d-c586-4020-9431-fc3a894d7002 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030316 Aug 18 14:58:00.998313 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 605/867] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:58:01.383987 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-6e056f13-f06c-46bf-8bce-3c141c13063a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:01.384737 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-6e056f13-f06c-46bf-8bce-3c141c13063a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:01.390980 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6e056f13-f06c-46bf-8bce-3c141c13063a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:01.391459 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6e056f13-f06c-46bf-8bce-3c141c13063a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:01.391952 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6e056f13-f06c-46bf-8bce-3c141c13063a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:01.392639 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6e056f13-f06c-46bf-8bce-3c141c13063a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:01.393094 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6e056f13-f06c-46bf-8bce-3c141c13063a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:01.393510 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6e056f13-f06c-46bf-8bce-3c141c13063a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:01.456075 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6e056f13-f06c-46bf-8bce-3c141c13063a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:01.463840 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-6e056f13-f06c-46bf-8bce-3c141c13063a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1621 microversion: 2.1 time: 0.084136 Aug 18 14:58:01.464399 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 606/868] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:01 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1621 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:58:01.654172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-cbc5decf-ada8-4524-b583-763062037ce5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:01.654873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-cbc5decf-ada8-4524-b583-763062037ce5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:01.662406 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cbc5decf-ada8-4524-b583-763062037ce5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:01.663245 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cbc5decf-ada8-4524-b583-763062037ce5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:01.663702 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cbc5decf-ada8-4524-b583-763062037ce5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:01.664403 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cbc5decf-ada8-4524-b583-763062037ce5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:01.664858 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cbc5decf-ada8-4524-b583-763062037ce5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:01.665274 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cbc5decf-ada8-4524-b583-763062037ce5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:01.669717 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:58:01.803331 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-cbc5decf-ada8-4524-b583-763062037ce5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:01.811721 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-cbc5decf-ada8-4524-b583-763062037ce5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:01.813257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-cbc5decf-ada8-4524-b583-763062037ce5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:01.814447 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-cbc5decf-ada8-4524-b583-763062037ce5 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1720 microversion: 2.20 time: 0.164246 Aug 18 14:58:01.815002 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 607/869] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:58:01 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:58:02.485736 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-be6bcd3f-3cef-4a8a-877e-ffdd6fc6e357 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:02.486425 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-be6bcd3f-3cef-4a8a-877e-ffdd6fc6e357 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:02.492813 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-be6bcd3f-3cef-4a8a-877e-ffdd6fc6e357 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:02.493312 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-be6bcd3f-3cef-4a8a-877e-ffdd6fc6e357 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:02.493735 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-be6bcd3f-3cef-4a8a-877e-ffdd6fc6e357 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:02.494460 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-be6bcd3f-3cef-4a8a-877e-ffdd6fc6e357 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:02.494914 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-be6bcd3f-3cef-4a8a-877e-ffdd6fc6e357 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:02.495339 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-be6bcd3f-3cef-4a8a-877e-ffdd6fc6e357 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:02.528021 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-be6bcd3f-3cef-4a8a-877e-ffdd6fc6e357 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:02.528493 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-be6bcd3f-3cef-4a8a-877e-ffdd6fc6e357 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:02.528922 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-be6bcd3f-3cef-4a8a-877e-ffdd6fc6e357 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:02.529356 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.objects.instance [None req-be6bcd3f-3cef-4a8a-877e-ffdd6fc6e357 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lazy-loading 'fault' on Instance uuid d9163961-387b-4e9b-94a8-9647dde7c208 {{(pid=132268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:58:02.573659 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-be6bcd3f-3cef-4a8a-877e-ffdd6fc6e357 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:02.583771 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-be6bcd3f-3cef-4a8a-877e-ffdd6fc6e357 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 200 len: 1335 microversion: 2.1 time: 0.100045 Aug 18 14:58:02.583771 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 608/870] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:02 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 1335 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:58:02.837761 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-9ea481ec-59dd-4cd9-ab38-6b0a7c3f49dc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:02.838293 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-9ea481ec-59dd-4cd9-ab38-6b0a7c3f49dc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:02.844282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9ea481ec-59dd-4cd9-ab38-6b0a7c3f49dc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:02.844766 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9ea481ec-59dd-4cd9-ab38-6b0a7c3f49dc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:02.845203 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9ea481ec-59dd-4cd9-ab38-6b0a7c3f49dc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:02.845888 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9ea481ec-59dd-4cd9-ab38-6b0a7c3f49dc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:02.846340 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9ea481ec-59dd-4cd9-ab38-6b0a7c3f49dc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:02.846761 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9ea481ec-59dd-4cd9-ab38-6b0a7c3f49dc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:02.982516 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-9ea481ec-59dd-4cd9-ab38-6b0a7c3f49dc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:02.991523 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-9ea481ec-59dd-4cd9-ab38-6b0a7c3f49dc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:02.993435 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-9ea481ec-59dd-4cd9-ab38-6b0a7c3f49dc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:02.994595 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-9ea481ec-59dd-4cd9-ab38-6b0a7c3f49dc tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1723 microversion: 2.20 time: 0.161324 Aug 18 14:58:02.995145 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 609/871] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:58:02 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:58:03.017153 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2a471522-faf6-4451-a558-d6d3687e3438 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "745e6d80-ad9d-40ef-93d0-9b31e5e3b5fe"}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:58:03.020027 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2a471522-faf6-4451-a558-d6d3687e3438 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:03.025846 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2a471522-faf6-4451-a558-d6d3687e3438 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:03.026331 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2a471522-faf6-4451-a558-d6d3687e3438 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:03.026768 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2a471522-faf6-4451-a558-d6d3687e3438 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:03.027471 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2a471522-faf6-4451-a558-d6d3687e3438 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:03.027948 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2a471522-faf6-4451-a558-d6d3687e3438 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:03.028375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2a471522-faf6-4451-a558-d6d3687e3438 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:03.297441 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2a471522-faf6-4451-a558-d6d3687e3438 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "POST /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.284450 Aug 18 14:58:03.298104 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 610/872] 10.222.0.36 () {62 vars in 1364 bytes} [Thu Aug 18 14:58:03 2022] POST /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1/os-volume_attachments => generated 188 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 14:58:03.427327 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2394e1e6-571e-4f0b-8a45-4748e56e6d1e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:03.427848 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2394e1e6-571e-4f0b-8a45-4748e56e6d1e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:03.433777 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2394e1e6-571e-4f0b-8a45-4748e56e6d1e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:03.434250 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2394e1e6-571e-4f0b-8a45-4748e56e6d1e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:03.434680 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2394e1e6-571e-4f0b-8a45-4748e56e6d1e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:03.435359 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2394e1e6-571e-4f0b-8a45-4748e56e6d1e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:03.435905 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2394e1e6-571e-4f0b-8a45-4748e56e6d1e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:03.436325 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2394e1e6-571e-4f0b-8a45-4748e56e6d1e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:03.683143 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2394e1e6-571e-4f0b-8a45-4748e56e6d1e tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1/os-volume_attachments/745e6d80-ad9d-40ef-93d0-9b31e5e3b5fe" status: 202 len: 0 microversion: 2.20 time: 0.260432 Aug 18 14:58:03.683869 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 611/873] 10.222.0.36 () {60 vars in 1457 bytes} [Thu Aug 18 14:58:03 2022] DELETE /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1/os-volume_attachments/745e6d80-ad9d-40ef-93d0-9b31e5e3b5fe => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 18 14:58:03.688936 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-82b1e0ef-b8f5-4d75-be38-f8a1e23e4375 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:03.689627 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-82b1e0ef-b8f5-4d75-be38-f8a1e23e4375 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: d9163961-387b-4e9b-94a8-9647dde7c208] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:03.695388 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-82b1e0ef-b8f5-4d75-be38-f8a1e23e4375 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:03.695914 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-82b1e0ef-b8f5-4d75-be38-f8a1e23e4375 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:03.696351 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-82b1e0ef-b8f5-4d75-be38-f8a1e23e4375 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:03.697042 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-82b1e0ef-b8f5-4d75-be38-f8a1e23e4375 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:03.697494 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-82b1e0ef-b8f5-4d75-be38-f8a1e23e4375 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:03.697915 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-82b1e0ef-b8f5-4d75-be38-f8a1e23e4375 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:03.711735 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-82b1e0ef-b8f5-4d75-be38-f8a1e23e4375 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] HTTP exception thrown: Instance d9163961-387b-4e9b-94a8-9647dde7c208 could not be found. Aug 18 14:58:03.713443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-82b1e0ef-b8f5-4d75-be38-f8a1e23e4375 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Request method failure captured: Aug 18 14:58:03.713443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 HTTP/1.1 Aug 18 14:58:03.713443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:58:03.713443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:58:03.713443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:58:03.713443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:58:03.713443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:58:03.713443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:58:03.713443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:58:03.713443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:58:03.713443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lJQwK2c115bNCfI9_4SFNLkllfgSZr5El1eNqitr3OQtjGAEW-PK-gbdLreyn40k786Z-SK2YhgyrUV5WJGnNRJIEHwtBu_7UfQYOE30KQE3ki2AOXsYaAaQyEq_0p9RnrNtYTZZ5VHW9FG03qMbGgeDDQs-wc6W0Yv5SdnYB7CjZs Aug 18 14:58:03.713443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:58:03.713443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:58:03.713443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:58:03.713443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:58:03.713443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:58:03.713443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:58:03.713443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: acc902aa109c4d7291c0bab62f80048e Aug 18 14:58:03.713443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1560225051 Aug 18 14:58:03.713443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:58:03.713443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:58:03.714861 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/acc902aa109c4d7291c0bab62f80048e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/acc902aa109c4d7291c0bab62f80048e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_acc902aa109c4d7291c0bab62f80048e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/acc902aa109c4d7291c0bab62f80048e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:58:03.714861 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1560225051 Aug 18 14:58:03.714861 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: acc902aa109c4d7291c0bab62f80048e Aug 18 14:58:03.714861 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1560225051 Aug 18 14:58:03.714861 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-ServerRescueNegativeTestJSON-1560225051-project Aug 18 14:58:03.714861 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:58:03.714861 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:58:03.714861 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 26eaa7f102bd41028983458ae48ff992 Aug 18 14:58:03.714861 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1560225051-project Aug 18 14:58:03.714861 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:58:03.714861 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance d9163961-387b-4e9b-94a8-9647dde7c208 could not be found. Aug 18 14:58:03.714861 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': 'd9163961-387b-4e9b-94a8-9647dde7c208'} Aug 18 14:58:03.715627 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:58:03.715627 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:03.715627 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:58:03.715627 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:58:03.715627 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:58:03.715627 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:58:03.715627 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:58:03.715627 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:58:03.715627 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:58:03.715627 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:58:03.715627 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9163961-387b-4e9b-94a8-9647dde7c208 could not be found. Aug 18 14:58:03.715627 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:03.715627 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:03.715627 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:03.715627 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:03.715627 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:03.715627 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:03.715627 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:58:03.715627 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:58:03.715627 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:58:03.716981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:58:03.716981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:58:03.716981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:58:03.716981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:58:03.716981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:58:03.716981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:58:03.716981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:58:03.716981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9163961-387b-4e9b-94a8-9647dde7c208 could not be found. Aug 18 14:58:03.716981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:03.716981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:03.716981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:03.716981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:03.716981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:03.716981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:03.716981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:58:03.716981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:58:03.716981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9163961-387b-4e9b-94a8-9647dde7c208 could not be found. Aug 18 14:58:03.716981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:03.718126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-82b1e0ef-b8f5-4d75-be38-f8a1e23e4375 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Returning 404 to user: Instance d9163961-387b-4e9b-94a8-9647dde7c208 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:58:03.718126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-82b1e0ef-b8f5-4d75-be38-f8a1e23e4375 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208" status: 404 len: 111 microversion: 2.1 time: 0.030114 Aug 18 14:58:03.718126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 612/874] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:03 2022] GET /compute/v2.1/servers/d9163961-387b-4e9b-94a8-9647dde7c208 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:58:03.724164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f3107095-1cd9-4839-bb9a-82115a7fda9b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '.version_select at 0x7fb2142eb790>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:03.742827 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f3107095-1cd9-4839-bb9a-82115a7fda9b tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1158265702" status: 202 len: 0 microversion: 2.1 time: 0.022727 Aug 18 14:58:03.743601 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 613/875] 10.222.0.36 () {58 vars in 1221 bytes} [Thu Aug 18 14:58:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1158265702 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 14:58:03.748945 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-036df26b-3f24-48d1-a40b-ef3240f08517 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:58:03.749538 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-036df26b-3f24-48d1-a40b-ef3240f08517 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:03.756774 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-036df26b-3f24-48d1-a40b-ef3240f08517 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:03.757254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-036df26b-3f24-48d1-a40b-ef3240f08517 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:03.757685 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-036df26b-3f24-48d1-a40b-ef3240f08517 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:03.758377 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-036df26b-3f24-48d1-a40b-ef3240f08517 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:03.758829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-036df26b-3f24-48d1-a40b-ef3240f08517 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:03.759251 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-036df26b-3f24-48d1-a40b-ef3240f08517 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:03.788843 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-036df26b-3f24-48d1-a40b-ef3240f08517 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132268) unshelve /opt/stack/nova/nova/compute/api.py:4587}} Aug 18 14:58:03.861046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-036df26b-3f24-48d1-a40b-ef3240f08517 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "POST /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1/action" status: 202 len: 0 microversion: 2.20 time: 0.115566 Aug 18 14:58:03.864837 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 614/876] 10.222.0.36 () {62 vars in 1319 bytes} [Thu Aug 18 14:58:03 2022] POST /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:58:03.870482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-867db3ca-d082-4fa5-91eb-9e0c110c959b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:03.870867 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-867db3ca-d082-4fa5-91eb-9e0c110c959b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:03.877111 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-867db3ca-d082-4fa5-91eb-9e0c110c959b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:03.877750 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-867db3ca-d082-4fa5-91eb-9e0c110c959b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:03.878857 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-867db3ca-d082-4fa5-91eb-9e0c110c959b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:03.879514 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-867db3ca-d082-4fa5-91eb-9e0c110c959b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:03.880037 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-867db3ca-d082-4fa5-91eb-9e0c110c959b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:03.880461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-867db3ca-d082-4fa5-91eb-9e0c110c959b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:04.134018 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-867db3ca-d082-4fa5-91eb-9e0c110c959b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:04.144659 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-867db3ca-d082-4fa5-91eb-9e0c110c959b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:04.146160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-867db3ca-d082-4fa5-91eb-9e0c110c959b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:04.148219 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-867db3ca-d082-4fa5-91eb-9e0c110c959b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1671 microversion: 2.20 time: 0.282173 Aug 18 14:58:04.148990 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 615/877] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:58:03 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1671 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:58:05.171454 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e5877410-0780-4f48-86ba-e8ca6b90d772 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:05.172134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e5877410-0780-4f48-86ba-e8ca6b90d772 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:05.178611 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e5877410-0780-4f48-86ba-e8ca6b90d772 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:05.179093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e5877410-0780-4f48-86ba-e8ca6b90d772 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:05.179524 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e5877410-0780-4f48-86ba-e8ca6b90d772 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:05.180242 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e5877410-0780-4f48-86ba-e8ca6b90d772 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:05.180692 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e5877410-0780-4f48-86ba-e8ca6b90d772 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:05.181116 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e5877410-0780-4f48-86ba-e8ca6b90d772 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:05.311979 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e5877410-0780-4f48-86ba-e8ca6b90d772 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:05.320752 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e5877410-0780-4f48-86ba-e8ca6b90d772 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:05.322274 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e5877410-0780-4f48-86ba-e8ca6b90d772 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:05.323415 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e5877410-0780-4f48-86ba-e8ca6b90d772 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1729 microversion: 2.20 time: 0.155869 Aug 18 14:58:05.323992 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 616/878] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:58:05 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:58:06.346320 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-aa53d798-37ba-43ee-bbdc-f0ee9ead2d1c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:06.346982 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-aa53d798-37ba-43ee-bbdc-f0ee9ead2d1c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:06.353391 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aa53d798-37ba-43ee-bbdc-f0ee9ead2d1c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:06.353877 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aa53d798-37ba-43ee-bbdc-f0ee9ead2d1c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:06.354310 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aa53d798-37ba-43ee-bbdc-f0ee9ead2d1c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:06.355008 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aa53d798-37ba-43ee-bbdc-f0ee9ead2d1c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:06.355461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aa53d798-37ba-43ee-bbdc-f0ee9ead2d1c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:06.355911 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aa53d798-37ba-43ee-bbdc-f0ee9ead2d1c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:06.837448 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-aa53d798-37ba-43ee-bbdc-f0ee9ead2d1c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:06.846406 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-aa53d798-37ba-43ee-bbdc-f0ee9ead2d1c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:06.848903 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-aa53d798-37ba-43ee-bbdc-f0ee9ead2d1c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:06.850458 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-aa53d798-37ba-43ee-bbdc-f0ee9ead2d1c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1729 microversion: 2.20 time: 0.507923 Aug 18 14:58:06.866292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 617/879] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:58:06 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1729 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:58:06.871262 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a0a52b3a-99c6-45b9-9d1c-935b0e792976 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:06.872000 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a0a52b3a-99c6-45b9-9d1c-935b0e792976 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:06.878531 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a0a52b3a-99c6-45b9-9d1c-935b0e792976 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:06.879223 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a0a52b3a-99c6-45b9-9d1c-935b0e792976 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:06.879894 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a0a52b3a-99c6-45b9-9d1c-935b0e792976 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:06.880785 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a0a52b3a-99c6-45b9-9d1c-935b0e792976 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:06.881605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a0a52b3a-99c6-45b9-9d1c-935b0e792976 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:06.882033 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a0a52b3a-99c6-45b9-9d1c-935b0e792976 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:06.908900 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a0a52b3a-99c6-45b9-9d1c-935b0e792976 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Going to try to terminate instance {{(pid=132268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:58:06.912660 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:58:07.004982 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a0a52b3a-99c6-45b9-9d1c-935b0e792976 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 204 len: 0 microversion: 2.1 time: 0.137251 Aug 18 14:58:07.005559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 618/880] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 14:58:06 2022] DELETE /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:58:07.011075 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c2c86cf4-7412-44a6-a807-ed453b02c2ce tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:07.013737 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c2c86cf4-7412-44a6-a807-ed453b02c2ce tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:07.020616 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c2c86cf4-7412-44a6-a807-ed453b02c2ce tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:07.021224 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c2c86cf4-7412-44a6-a807-ed453b02c2ce tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:07.021717 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c2c86cf4-7412-44a6-a807-ed453b02c2ce tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:07.022531 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c2c86cf4-7412-44a6-a807-ed453b02c2ce tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:07.023043 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c2c86cf4-7412-44a6-a807-ed453b02c2ce tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:07.023524 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c2c86cf4-7412-44a6-a807-ed453b02c2ce tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:07.054545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c2c86cf4-7412-44a6-a807-ed453b02c2ce tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047715 Aug 18 14:58:07.055093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 619/881] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Aug 18 14:58:07 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:58:07.060236 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-63f18b5a-3015-45fe-be6a-247c6799aae7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:07.060386 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-63f18b5a-3015-45fe-be6a-247c6799aae7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:07.066223 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-63f18b5a-3015-45fe-be6a-247c6799aae7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:07.066700 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-63f18b5a-3015-45fe-be6a-247c6799aae7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:07.067155 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-63f18b5a-3015-45fe-be6a-247c6799aae7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:07.067876 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-63f18b5a-3015-45fe-be6a-247c6799aae7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:07.068338 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-63f18b5a-3015-45fe-be6a-247c6799aae7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:07.068836 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-63f18b5a-3015-45fe-be6a-247c6799aae7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:07.214086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-63f18b5a-3015-45fe-be6a-247c6799aae7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:07.221690 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-63f18b5a-3015-45fe-be6a-247c6799aae7 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1508 microversion: 2.1 time: 0.165588 Aug 18 14:58:07.222339 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 620/882] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:07 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:58:07.226962 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-771295eb-bc44-4a33-be0a-e6483f54ad90 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:07.227563 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-771295eb-bc44-4a33-be0a-e6483f54ad90 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:07.233744 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-771295eb-bc44-4a33-be0a-e6483f54ad90 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:07.234317 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-771295eb-bc44-4a33-be0a-e6483f54ad90 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:07.234776 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-771295eb-bc44-4a33-be0a-e6483f54ad90 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:07.235525 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-771295eb-bc44-4a33-be0a-e6483f54ad90 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:07.235997 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-771295eb-bc44-4a33-be0a-e6483f54ad90 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:07.236623 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-771295eb-bc44-4a33-be0a-e6483f54ad90 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:07.266411 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-771295eb-bc44-4a33-be0a-e6483f54ad90 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303/os-volume_attachments/6f1171ef-c9ed-4323-8c52-bd1638e607b2" status: 200 len: 194 microversion: 2.1 time: 0.043014 Aug 18 14:58:07.266977 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 621/883] 10.222.0.36 () {58 vars in 1413 bytes} [Thu Aug 18 14:58:07 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303/os-volume_attachments/6f1171ef-c9ed-4323-8c52-bd1638e607b2 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:58:07.277442 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0907ee3e-2534-4e2f-b320-77872f93b9b7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:07.277926 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0907ee3e-2534-4e2f-b320-77872f93b9b7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:07.283758 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0907ee3e-2534-4e2f-b320-77872f93b9b7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:07.284363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0907ee3e-2534-4e2f-b320-77872f93b9b7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:07.284844 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0907ee3e-2534-4e2f-b320-77872f93b9b7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:07.285524 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0907ee3e-2534-4e2f-b320-77872f93b9b7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:07.285971 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0907ee3e-2534-4e2f-b320-77872f93b9b7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:07.286387 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0907ee3e-2534-4e2f-b320-77872f93b9b7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:07.365111 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.objects.instance [None req-0907ee3e-2534-4e2f-b320-77872f93b9b7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lazy-loading 'services' on Instance uuid 0587b3b6-bb0f-443b-8b28-0035ad738303 {{(pid=132268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:58:07.438741 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0907ee3e-2534-4e2f-b320-77872f93b9b7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303/os-volume_attachments/6f1171ef-c9ed-4323-8c52-bd1638e607b2" status: 202 len: 0 microversion: 2.1 time: 0.164815 Aug 18 14:58:07.439333 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 622/884] 10.222.0.36 () {58 vars in 1416 bytes} [Thu Aug 18 14:58:07 2022] DELETE /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303/os-volume_attachments/6f1171ef-c9ed-4323-8c52-bd1638e607b2 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 14:58:07.874369 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d6598443-4867-4d78-a4c3-c8bdccfa5cec tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:07.875056 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d6598443-4867-4d78-a4c3-c8bdccfa5cec tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:07.882246 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d6598443-4867-4d78-a4c3-c8bdccfa5cec tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:07.882743 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d6598443-4867-4d78-a4c3-c8bdccfa5cec tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:07.883179 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d6598443-4867-4d78-a4c3-c8bdccfa5cec tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:07.883911 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d6598443-4867-4d78-a4c3-c8bdccfa5cec tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:07.884369 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d6598443-4867-4d78-a4c3-c8bdccfa5cec tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:07.884792 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d6598443-4867-4d78-a4c3-c8bdccfa5cec tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:08.018038 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d6598443-4867-4d78-a4c3-c8bdccfa5cec tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:08.026428 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d6598443-4867-4d78-a4c3-c8bdccfa5cec tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:08.027975 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d6598443-4867-4d78-a4c3-c8bdccfa5cec tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:08.029135 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d6598443-4867-4d78-a4c3-c8bdccfa5cec tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1729 microversion: 2.20 time: 0.159230 Aug 18 14:58:08.029686 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 623/885] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:58:07 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:58:08.242788 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-02284f13-97bb-4def-a20d-1948e52273d6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:08.243406 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-02284f13-97bb-4def-a20d-1948e52273d6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:08.249408 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-02284f13-97bb-4def-a20d-1948e52273d6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:08.249891 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-02284f13-97bb-4def-a20d-1948e52273d6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:08.250329 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-02284f13-97bb-4def-a20d-1948e52273d6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:08.251020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-02284f13-97bb-4def-a20d-1948e52273d6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:08.251477 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-02284f13-97bb-4def-a20d-1948e52273d6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:08.251932 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-02284f13-97bb-4def-a20d-1948e52273d6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:08.384608 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-02284f13-97bb-4def-a20d-1948e52273d6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:08.392504 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-02284f13-97bb-4def-a20d-1948e52273d6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1508 microversion: 2.1 time: 0.153635 Aug 18 14:58:08.393059 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 624/886] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:08 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:58:09.052448 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-94410ecf-bca2-49ce-ab22-bc6e2a6a8e89 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:09.053050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-94410ecf-bca2-49ce-ab22-bc6e2a6a8e89 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:09.059029 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-94410ecf-bca2-49ce-ab22-bc6e2a6a8e89 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:09.059499 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-94410ecf-bca2-49ce-ab22-bc6e2a6a8e89 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:09.059960 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-94410ecf-bca2-49ce-ab22-bc6e2a6a8e89 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:09.060637 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-94410ecf-bca2-49ce-ab22-bc6e2a6a8e89 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:09.061080 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-94410ecf-bca2-49ce-ab22-bc6e2a6a8e89 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:09.061503 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-94410ecf-bca2-49ce-ab22-bc6e2a6a8e89 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:09.190387 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-94410ecf-bca2-49ce-ab22-bc6e2a6a8e89 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:09.198977 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-94410ecf-bca2-49ce-ab22-bc6e2a6a8e89 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:09.200563 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-94410ecf-bca2-49ce-ab22-bc6e2a6a8e89 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:09.201724 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-94410ecf-bca2-49ce-ab22-bc6e2a6a8e89 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1729 microversion: 2.20 time: 0.153827 Aug 18 14:58:09.202291 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 625/887] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:58:09 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:58:09.414440 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-75eecca9-b7b9-4dee-a04b-f2feb5a3e29a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:09.415070 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-75eecca9-b7b9-4dee-a04b-f2feb5a3e29a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:09.421668 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-75eecca9-b7b9-4dee-a04b-f2feb5a3e29a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:09.422156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-75eecca9-b7b9-4dee-a04b-f2feb5a3e29a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:09.422641 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-75eecca9-b7b9-4dee-a04b-f2feb5a3e29a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:09.423516 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-75eecca9-b7b9-4dee-a04b-f2feb5a3e29a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:09.423997 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-75eecca9-b7b9-4dee-a04b-f2feb5a3e29a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:09.424415 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-75eecca9-b7b9-4dee-a04b-f2feb5a3e29a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:09.574336 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-75eecca9-b7b9-4dee-a04b-f2feb5a3e29a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:09.583629 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-75eecca9-b7b9-4dee-a04b-f2feb5a3e29a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1508 microversion: 2.1 time: 0.173751 Aug 18 14:58:09.584418 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 626/888] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:09 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:58:10.225940 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-89879b3b-0f92-49d3-a689-f2fd2b773e1b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:10.226555 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-89879b3b-0f92-49d3-a689-f2fd2b773e1b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:10.233168 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-89879b3b-0f92-49d3-a689-f2fd2b773e1b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:10.233656 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-89879b3b-0f92-49d3-a689-f2fd2b773e1b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:10.234091 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-89879b3b-0f92-49d3-a689-f2fd2b773e1b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:10.234787 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-89879b3b-0f92-49d3-a689-f2fd2b773e1b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:10.235247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-89879b3b-0f92-49d3-a689-f2fd2b773e1b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:10.235669 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-89879b3b-0f92-49d3-a689-f2fd2b773e1b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:10.375716 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-89879b3b-0f92-49d3-a689-f2fd2b773e1b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:10.385063 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-89879b3b-0f92-49d3-a689-f2fd2b773e1b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:10.386591 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-89879b3b-0f92-49d3-a689-f2fd2b773e1b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:10.388073 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-89879b3b-0f92-49d3-a689-f2fd2b773e1b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1729 microversion: 2.20 time: 0.166534 Aug 18 14:58:10.388630 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 627/889] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:58:10 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:58:10.605417 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-4ea2cec6-8bf3-41e3-a7ab-30bc471bc4d6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:10.606053 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-4ea2cec6-8bf3-41e3-a7ab-30bc471bc4d6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:10.612708 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4ea2cec6-8bf3-41e3-a7ab-30bc471bc4d6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:10.613193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4ea2cec6-8bf3-41e3-a7ab-30bc471bc4d6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:10.613647 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4ea2cec6-8bf3-41e3-a7ab-30bc471bc4d6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:10.614342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4ea2cec6-8bf3-41e3-a7ab-30bc471bc4d6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:10.614796 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4ea2cec6-8bf3-41e3-a7ab-30bc471bc4d6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:10.615218 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4ea2cec6-8bf3-41e3-a7ab-30bc471bc4d6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:10.759709 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-4ea2cec6-8bf3-41e3-a7ab-30bc471bc4d6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:10.768008 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-4ea2cec6-8bf3-41e3-a7ab-30bc471bc4d6 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1508 microversion: 2.1 time: 0.166510 Aug 18 14:58:10.768578 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 628/890] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:10 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:58:11.411294 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-72af8750-0479-42cd-a9f2-95667cecf827 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:11.411857 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-72af8750-0479-42cd-a9f2-95667cecf827 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:11.418001 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-72af8750-0479-42cd-a9f2-95667cecf827 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:11.418491 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-72af8750-0479-42cd-a9f2-95667cecf827 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:11.418928 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-72af8750-0479-42cd-a9f2-95667cecf827 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:11.419621 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-72af8750-0479-42cd-a9f2-95667cecf827 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:11.420103 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-72af8750-0479-42cd-a9f2-95667cecf827 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:11.420523 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-72af8750-0479-42cd-a9f2-95667cecf827 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:11.571006 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-72af8750-0479-42cd-a9f2-95667cecf827 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:11.580103 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-72af8750-0479-42cd-a9f2-95667cecf827 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:11.582171 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-72af8750-0479-42cd-a9f2-95667cecf827 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:11.584078 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-72af8750-0479-42cd-a9f2-95667cecf827 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1729 microversion: 2.20 time: 0.177346 Aug 18 14:58:11.584851 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 629/891] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:58:11 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:58:11.789104 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-557dad46-25d9-481d-9257-a45971379a3c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:11.789764 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-557dad46-25d9-481d-9257-a45971379a3c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:11.796672 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-557dad46-25d9-481d-9257-a45971379a3c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:11.797156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-557dad46-25d9-481d-9257-a45971379a3c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:11.797586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-557dad46-25d9-481d-9257-a45971379a3c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:11.798506 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-557dad46-25d9-481d-9257-a45971379a3c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:11.798957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-557dad46-25d9-481d-9257-a45971379a3c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:11.799377 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-557dad46-25d9-481d-9257-a45971379a3c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:11.937645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-557dad46-25d9-481d-9257-a45971379a3c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:11.948655 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-557dad46-25d9-481d-9257-a45971379a3c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1508 microversion: 2.1 time: 0.163411 Aug 18 14:58:11.949488 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 630/892] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:11 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:58:12.202714 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-e184434a-e1cf-4120-92a0-15e90575406a req-0380c8c1-dea0-416c-a420-94ec590323d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d75ecea-5192-4c86-a265-85dccf4228a4", "name": "network-vif-unplugged", "status": "completed", "tag": "52d7cb31-d8e2-496b-a360-26d43f2b5c2a"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:58:12.215564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-e184434a-e1cf-4120-92a0-15e90575406a req-0380c8c1-dea0-416c-a420-94ec590323d9 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:12.216554 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-e184434a-e1cf-4120-92a0-15e90575406a req-0380c8c1-dea0-416c-a420-94ec590323d9 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:12.217535 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-e184434a-e1cf-4120-92a0-15e90575406a req-0380c8c1-dea0-416c-a420-94ec590323d9 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:12.231433 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-e184434a-e1cf-4120-92a0-15e90575406a req-0380c8c1-dea0-416c-a420-94ec590323d9 service nova] Creating event network-vif-unplugged:52d7cb31-d8e2-496b-a360-26d43f2b5c2a for instance 2d75ecea-5192-4c86-a265-85dccf4228a4 on hv-cinder-85220 Aug 18 14:58:12.236958 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-e184434a-e1cf-4120-92a0-15e90575406a req-0380c8c1-dea0-416c-a420-94ec590323d9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038034 Aug 18 14:58:12.238352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 631/893] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:58:12.608279 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f1dc16b4-a07e-4dd9-a2da-e3286391295f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:12.609251 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f1dc16b4-a07e-4dd9-a2da-e3286391295f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:12.616193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f1dc16b4-a07e-4dd9-a2da-e3286391295f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:12.616715 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f1dc16b4-a07e-4dd9-a2da-e3286391295f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:12.617149 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f1dc16b4-a07e-4dd9-a2da-e3286391295f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:12.617847 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f1dc16b4-a07e-4dd9-a2da-e3286391295f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:12.618300 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f1dc16b4-a07e-4dd9-a2da-e3286391295f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:12.618755 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f1dc16b4-a07e-4dd9-a2da-e3286391295f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:12.759560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f1dc16b4-a07e-4dd9-a2da-e3286391295f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:12.768249 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f1dc16b4-a07e-4dd9-a2da-e3286391295f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:12.769726 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f1dc16b4-a07e-4dd9-a2da-e3286391295f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:12.771419 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f1dc16b4-a07e-4dd9-a2da-e3286391295f tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1729 microversion: 2.20 time: 0.167784 Aug 18 14:58:12.772202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 632/894] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:58:12 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:58:12.972121 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-aa256619-5114-43e9-aa16-5e8ecbc026b5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:12.975149 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-aa256619-5114-43e9-aa16-5e8ecbc026b5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:12.982869 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aa256619-5114-43e9-aa16-5e8ecbc026b5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:12.983488 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aa256619-5114-43e9-aa16-5e8ecbc026b5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:12.984018 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aa256619-5114-43e9-aa16-5e8ecbc026b5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:12.984944 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aa256619-5114-43e9-aa16-5e8ecbc026b5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:12.985479 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aa256619-5114-43e9-aa16-5e8ecbc026b5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:12.986151 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aa256619-5114-43e9-aa16-5e8ecbc026b5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:13.140560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-aa256619-5114-43e9-aa16-5e8ecbc026b5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:13.144311 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:58:13.149832 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-aa256619-5114-43e9-aa16-5e8ecbc026b5 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1508 microversion: 2.1 time: 0.183111 Aug 18 14:58:13.150416 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 633/895] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:12 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:58:13.726059 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d6dd85ec-d950-4a96-bcb2-ca3d7edadff5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:13.726909 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d6dd85ec-d950-4a96-bcb2-ca3d7edadff5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:13.731426 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:58:13.736088 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d6dd85ec-d950-4a96-bcb2-ca3d7edadff5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:13.736615 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d6dd85ec-d950-4a96-bcb2-ca3d7edadff5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:13.737116 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d6dd85ec-d950-4a96-bcb2-ca3d7edadff5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:13.737865 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d6dd85ec-d950-4a96-bcb2-ca3d7edadff5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:13.738340 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d6dd85ec-d950-4a96-bcb2-ca3d7edadff5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:13.738765 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d6dd85ec-d950-4a96-bcb2-ca3d7edadff5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:13.766083 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d6dd85ec-d950-4a96-bcb2-ca3d7edadff5 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86/ips" status: 200 len: 150 microversion: 2.1 time: 0.044575 Aug 18 14:58:13.773429 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 634/896] 10.222.0.36 () {58 vars in 1248 bytes} [Thu Aug 18 14:58:13 2022] GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86/ips => generated 150 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:58:13.798056 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-24b84b59-a41a-4c99-b2c6-313af4d65a77 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:13.798673 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-24b84b59-a41a-4c99-b2c6-313af4d65a77 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:13.805035 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-24b84b59-a41a-4c99-b2c6-313af4d65a77 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:13.805526 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-24b84b59-a41a-4c99-b2c6-313af4d65a77 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:13.805957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-24b84b59-a41a-4c99-b2c6-313af4d65a77 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:13.806805 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-24b84b59-a41a-4c99-b2c6-313af4d65a77 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:13.807270 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-24b84b59-a41a-4c99-b2c6-313af4d65a77 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:13.807717 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-24b84b59-a41a-4c99-b2c6-313af4d65a77 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:14.000987 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-24b84b59-a41a-4c99-b2c6-313af4d65a77 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:14.010961 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-24b84b59-a41a-4c99-b2c6-313af4d65a77 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:14.012648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-24b84b59-a41a-4c99-b2c6-313af4d65a77 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:14.014105 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-24b84b59-a41a-4c99-b2c6-313af4d65a77 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1729 microversion: 2.20 time: 0.220284 Aug 18 14:58:14.014856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 635/897] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:58:13 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:58:14.176900 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-dbfef80e-8592-4242-8a35-aff34f9ce157 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:14.178261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-dbfef80e-8592-4242-8a35-aff34f9ce157 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:14.185153 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dbfef80e-8592-4242-8a35-aff34f9ce157 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:14.185638 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dbfef80e-8592-4242-8a35-aff34f9ce157 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:14.186572 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dbfef80e-8592-4242-8a35-aff34f9ce157 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:14.187571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dbfef80e-8592-4242-8a35-aff34f9ce157 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:14.188102 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dbfef80e-8592-4242-8a35-aff34f9ce157 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:14.188624 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dbfef80e-8592-4242-8a35-aff34f9ce157 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:14.364743 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-dbfef80e-8592-4242-8a35-aff34f9ce157 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:14.373698 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-dbfef80e-8592-4242-8a35-aff34f9ce157 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1508 microversion: 2.1 time: 0.205280 Aug 18 14:58:14.374279 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 636/898] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:14 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1508 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:58:15.038549 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-63ed4217-e6f9-406f-89a5-69a202f6703c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:15.039230 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-63ed4217-e6f9-406f-89a5-69a202f6703c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:15.046353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-63ed4217-e6f9-406f-89a5-69a202f6703c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:15.046843 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-63ed4217-e6f9-406f-89a5-69a202f6703c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:15.047332 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-63ed4217-e6f9-406f-89a5-69a202f6703c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:15.048070 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-63ed4217-e6f9-406f-89a5-69a202f6703c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:15.048524 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-63ed4217-e6f9-406f-89a5-69a202f6703c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:15.048954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-63ed4217-e6f9-406f-89a5-69a202f6703c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:15.187857 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-63ed4217-e6f9-406f-89a5-69a202f6703c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:15.206093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-63ed4217-e6f9-406f-89a5-69a202f6703c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:15.208828 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-63ed4217-e6f9-406f-89a5-69a202f6703c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:15.210040 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-63ed4217-e6f9-406f-89a5-69a202f6703c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1729 microversion: 2.20 time: 0.175467 Aug 18 14:58:15.210610 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 637/899] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:58:15 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:58:15.231521 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-26b7d984-774d-4150-8100-ed81e62fc20c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01d1aad6-3b13-44f7-8fa5-9ec06a09f0f3"}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:58:15.234289 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-26b7d984-774d-4150-8100-ed81e62fc20c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:15.241403 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26b7d984-774d-4150-8100-ed81e62fc20c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:15.241902 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26b7d984-774d-4150-8100-ed81e62fc20c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:15.242376 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26b7d984-774d-4150-8100-ed81e62fc20c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:15.243093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26b7d984-774d-4150-8100-ed81e62fc20c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:15.243547 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26b7d984-774d-4150-8100-ed81e62fc20c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:15.244017 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26b7d984-774d-4150-8100-ed81e62fc20c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:19.582988 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-26b7d984-774d-4150-8100-ed81e62fc20c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "POST /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.355292 Aug 18 14:58:19.583788 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 638/900] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Aug 18 14:58:15 2022] POST /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86/os-volume_attachments => generated 194 bytes in 4357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:58:19.588546 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b807da82-d746-4917-aa2e-1d2630f79e72 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:19.589240 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b807da82-d746-4917-aa2e-1d2630f79e72 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:19.595392 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b807da82-d746-4917-aa2e-1d2630f79e72 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:19.596075 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b807da82-d746-4917-aa2e-1d2630f79e72 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:19.596507 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b807da82-d746-4917-aa2e-1d2630f79e72 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:19.597207 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b807da82-d746-4917-aa2e-1d2630f79e72 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:19.597660 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b807da82-d746-4917-aa2e-1d2630f79e72 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:19.598086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b807da82-d746-4917-aa2e-1d2630f79e72 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:19.629769 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b807da82-d746-4917-aa2e-1d2630f79e72 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:19.630827 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b807da82-d746-4917-aa2e-1d2630f79e72 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:19.631259 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b807da82-d746-4917-aa2e-1d2630f79e72 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:19.631725 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.objects.instance [None req-b807da82-d746-4917-aa2e-1d2630f79e72 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lazy-loading 'fault' on Instance uuid 2d75ecea-5192-4c86-a265-85dccf4228a4 {{(pid=132268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:58:19.672957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b807da82-d746-4917-aa2e-1d2630f79e72 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:19.681316 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b807da82-d746-4917-aa2e-1d2630f79e72 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 200 len: 1312 microversion: 2.1 time: 0.096632 Aug 18 14:58:19.681883 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 639/901] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:19 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:58:19.686222 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-55587bd0-bc83-4782-b122-4babeb79ca13 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:19.686829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-55587bd0-bc83-4782-b122-4babeb79ca13 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:19.692396 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-55587bd0-bc83-4782-b122-4babeb79ca13 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:19.693485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-55587bd0-bc83-4782-b122-4babeb79ca13 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:19.693919 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-55587bd0-bc83-4782-b122-4babeb79ca13 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:19.694609 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-55587bd0-bc83-4782-b122-4babeb79ca13 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:19.695061 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-55587bd0-bc83-4782-b122-4babeb79ca13 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:19.695482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-55587bd0-bc83-4782-b122-4babeb79ca13 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:19.827453 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-55587bd0-bc83-4782-b122-4babeb79ca13 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:19.836240 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-55587bd0-bc83-4782-b122-4babeb79ca13 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:19.837728 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-55587bd0-bc83-4782-b122-4babeb79ca13 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:19.838890 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-55587bd0-bc83-4782-b122-4babeb79ca13 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1729 microversion: 2.20 time: 0.156103 Aug 18 14:58:19.839447 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 640/902] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:58:19 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:58:19.843756 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-fb2d57e9-245a-428b-a1bd-121d8bd269ad req-b866d0fb-96e5-437f-8945-d584561ee876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d75ecea-5192-4c86-a265-85dccf4228a4", "name": "network-vif-deleted", "tag": "52d7cb31-d8e2-496b-a360-26d43f2b5c2a"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:58:19.854254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-fb2d57e9-245a-428b-a1bd-121d8bd269ad req-b866d0fb-96e5-437f-8945-d584561ee876 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:19.854730 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-fb2d57e9-245a-428b-a1bd-121d8bd269ad req-b866d0fb-96e5-437f-8945-d584561ee876 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:19.855158 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-fb2d57e9-245a-428b-a1bd-121d8bd269ad req-b866d0fb-96e5-437f-8945-d584561ee876 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:19.866334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-fb2d57e9-245a-428b-a1bd-121d8bd269ad req-b866d0fb-96e5-437f-8945-d584561ee876 service nova] Creating event network-vif-deleted:52d7cb31-d8e2-496b-a360-26d43f2b5c2a for instance 2d75ecea-5192-4c86-a265-85dccf4228a4 on hv-cinder-85220 Aug 18 14:58:19.871051 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-fb2d57e9-245a-428b-a1bd-121d8bd269ad req-b866d0fb-96e5-437f-8945-d584561ee876 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030483 Aug 18 14:58:19.871638 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 641/903] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:58:20.276215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2c2a27c7-267b-45d2-8b41-5cc5e0d70edc tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:20.277000 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2c2a27c7-267b-45d2-8b41-5cc5e0d70edc tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:20.283239 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2c2a27c7-267b-45d2-8b41-5cc5e0d70edc tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:20.283757 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2c2a27c7-267b-45d2-8b41-5cc5e0d70edc tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:20.284205 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2c2a27c7-267b-45d2-8b41-5cc5e0d70edc tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:20.284943 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2c2a27c7-267b-45d2-8b41-5cc5e0d70edc tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:20.285399 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2c2a27c7-267b-45d2-8b41-5cc5e0d70edc tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:20.285828 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2c2a27c7-267b-45d2-8b41-5cc5e0d70edc tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:20.322827 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2c2a27c7-267b-45d2-8b41-5cc5e0d70edc tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303/os-volume_attachments/923c5fd2-4932-468b-9ebe-1d1586d8168e" status: 200 len: 194 microversion: 2.1 time: 0.051517 Aug 18 14:58:20.323755 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 642/904] 10.222.0.36 () {58 vars in 1413 bytes} [Thu Aug 18 14:58:20 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303/os-volume_attachments/923c5fd2-4932-468b-9ebe-1d1586d8168e => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:58:20.347062 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-bd412f15-0cf6-41a7-b1e3-5fb1b41df630 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:20.348915 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-bd412f15-0cf6-41a7-b1e3-5fb1b41df630 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:20.358934 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bd412f15-0cf6-41a7-b1e3-5fb1b41df630 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:20.360772 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bd412f15-0cf6-41a7-b1e3-5fb1b41df630 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:20.361549 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bd412f15-0cf6-41a7-b1e3-5fb1b41df630 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:20.365455 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bd412f15-0cf6-41a7-b1e3-5fb1b41df630 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:20.366661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bd412f15-0cf6-41a7-b1e3-5fb1b41df630 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:20.367317 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bd412f15-0cf6-41a7-b1e3-5fb1b41df630 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:20.466645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.objects.instance [None req-bd412f15-0cf6-41a7-b1e3-5fb1b41df630 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lazy-loading 'services' on Instance uuid 0587b3b6-bb0f-443b-8b28-0035ad738303 {{(pid=132268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:58:20.545500 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-bd412f15-0cf6-41a7-b1e3-5fb1b41df630 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303/os-volume_attachments/923c5fd2-4932-468b-9ebe-1d1586d8168e" status: 202 len: 0 microversion: 2.1 time: 0.214625 Aug 18 14:58:20.546082 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 643/905] 10.222.0.36 () {58 vars in 1416 bytes} [Thu Aug 18 14:58:20 2022] DELETE /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303/os-volume_attachments/923c5fd2-4932-468b-9ebe-1d1586d8168e => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 14:58:20.703181 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-bab6948a-4a1c-4456-a5c4-7de0425fea80 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:20.704053 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-bab6948a-4a1c-4456-a5c4-7de0425fea80 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 2d75ecea-5192-4c86-a265-85dccf4228a4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:20.710819 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bab6948a-4a1c-4456-a5c4-7de0425fea80 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:20.711477 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bab6948a-4a1c-4456-a5c4-7de0425fea80 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:20.712151 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bab6948a-4a1c-4456-a5c4-7de0425fea80 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:20.712863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bab6948a-4a1c-4456-a5c4-7de0425fea80 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:20.713309 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bab6948a-4a1c-4456-a5c4-7de0425fea80 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:20.713903 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-bab6948a-4a1c-4456-a5c4-7de0425fea80 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:20.729228 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-bab6948a-4a1c-4456-a5c4-7de0425fea80 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] HTTP exception thrown: Instance 2d75ecea-5192-4c86-a265-85dccf4228a4 could not be found. Aug 18 14:58:20.730981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-bab6948a-4a1c-4456-a5c4-7de0425fea80 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Request method failure captured: Aug 18 14:58:20.730981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 HTTP/1.1 Aug 18 14:58:20.730981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:58:20.730981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:58:20.730981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:58:20.730981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:58:20.730981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:58:20.730981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:58:20.730981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:58:20.730981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:58:20.730981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lJQwK2c115bNCfI9_4SFNLkllfgSZr5El1eNqitr3OQtjGAEW-PK-gbdLreyn40k786Z-SK2YhgyrUV5WJGnNRJIEHwtBu_7UfQYOE30KQE3ki2AOXsYaAaQyEq_0p9RnrNtYTZZ5VHW9FG03qMbGgeDDQs-wc6W0Yv5SdnYB7CjZs Aug 18 14:58:20.730981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:58:20.730981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:58:20.730981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:58:20.730981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:58:20.730981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:58:20.730981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:58:20.730981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: acc902aa109c4d7291c0bab62f80048e Aug 18 14:58:20.730981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1560225051 Aug 18 14:58:20.730981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:58:20.730981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:58:20.732940 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/acc902aa109c4d7291c0bab62f80048e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/acc902aa109c4d7291c0bab62f80048e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_acc902aa109c4d7291c0bab62f80048e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/acc902aa109c4d7291c0bab62f80048e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:58:20.732940 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1560225051 Aug 18 14:58:20.732940 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: acc902aa109c4d7291c0bab62f80048e Aug 18 14:58:20.732940 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1560225051 Aug 18 14:58:20.732940 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-ServerRescueNegativeTestJSON-1560225051-project Aug 18 14:58:20.732940 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:58:20.732940 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:58:20.732940 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 26eaa7f102bd41028983458ae48ff992 Aug 18 14:58:20.732940 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1560225051-project Aug 18 14:58:20.732940 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:58:20.732940 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 2d75ecea-5192-4c86-a265-85dccf4228a4 could not be found. Aug 18 14:58:20.732940 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '2d75ecea-5192-4c86-a265-85dccf4228a4'} Aug 18 14:58:20.744727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:58:20.744727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:20.744727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:58:20.744727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:58:20.744727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:58:20.744727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:58:20.744727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:58:20.744727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:58:20.744727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:58:20.744727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:58:20.744727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d75ecea-5192-4c86-a265-85dccf4228a4 could not be found. Aug 18 14:58:20.744727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:20.744727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:20.744727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:20.744727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:20.744727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:20.744727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:20.744727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:58:20.744727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:58:20.744727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:58:20.746382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:58:20.746382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:58:20.746382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:58:20.746382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:58:20.746382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:58:20.746382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:58:20.746382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:58:20.746382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d75ecea-5192-4c86-a265-85dccf4228a4 could not be found. Aug 18 14:58:20.746382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:20.746382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:20.746382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:20.746382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:20.746382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:20.746382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:20.746382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:58:20.746382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:58:20.746382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d75ecea-5192-4c86-a265-85dccf4228a4 could not be found. Aug 18 14:58:20.746382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:20.747931 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-bab6948a-4a1c-4456-a5c4-7de0425fea80 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Returning 404 to user: Instance 2d75ecea-5192-4c86-a265-85dccf4228a4 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:58:20.747931 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-bab6948a-4a1c-4456-a5c4-7de0425fea80 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4" status: 404 len: 111 microversion: 2.1 time: 0.034401 Aug 18 14:58:20.747931 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 644/906] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:20 2022] GET /compute/v2.1/servers/2d75ecea-5192-4c86-a265-85dccf4228a4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 14:58:20.747931 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-1495f42d-d54c-466e-a3ab-ce0d34b2d132 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:20.747931 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-1495f42d-d54c-466e-a3ab-ce0d34b2d132 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:20.753114 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1495f42d-d54c-466e-a3ab-ce0d34b2d132 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:20.753605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1495f42d-d54c-466e-a3ab-ce0d34b2d132 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:20.754039 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1495f42d-d54c-466e-a3ab-ce0d34b2d132 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:20.754742 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1495f42d-d54c-466e-a3ab-ce0d34b2d132 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:20.755260 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1495f42d-d54c-466e-a3ab-ce0d34b2d132 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:20.755706 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1495f42d-d54c-466e-a3ab-ce0d34b2d132 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:20.781658 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-1495f42d-d54c-466e-a3ab-ce0d34b2d132 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Going to try to terminate instance {{(pid=132268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:58:20.859193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-1495f42d-d54c-466e-a3ab-ce0d34b2d132 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "DELETE /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 204 len: 0 microversion: 2.1 time: 0.120285 Aug 18 14:58:20.859877 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 645/907] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 14:58:20 2022] DELETE /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:58:20.869150 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a7c39765-3a11-4eeb-abe5-6ec87f6ec6f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:20.869852 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a7c39765-3a11-4eeb-abe5-6ec87f6ec6f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:20.876305 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a7c39765-3a11-4eeb-abe5-6ec87f6ec6f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:20.876797 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a7c39765-3a11-4eeb-abe5-6ec87f6ec6f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:20.877229 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a7c39765-3a11-4eeb-abe5-6ec87f6ec6f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:20.877915 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a7c39765-3a11-4eeb-abe5-6ec87f6ec6f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:20.878594 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a7c39765-3a11-4eeb-abe5-6ec87f6ec6f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:20.879005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a7c39765-3a11-4eeb-abe5-6ec87f6ec6f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:21.017174 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a7c39765-3a11-4eeb-abe5-6ec87f6ec6f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:21.026259 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a7c39765-3a11-4eeb-abe5-6ec87f6ec6f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:21.028734 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a7c39765-3a11-4eeb-abe5-6ec87f6ec6f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:21.031102 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a7c39765-3a11-4eeb-abe5-6ec87f6ec6f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1729 microversion: 2.20 time: 0.169976 Aug 18 14:58:21.031699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 646/908] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:58:20 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:58:21.036177 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-cf4f85e7-3cfa-44a1-9a9c-defdaf47336a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:21.037297 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-cf4f85e7-3cfa-44a1-9a9c-defdaf47336a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:21.043232 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cf4f85e7-3cfa-44a1-9a9c-defdaf47336a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:21.043732 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cf4f85e7-3cfa-44a1-9a9c-defdaf47336a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:21.044176 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cf4f85e7-3cfa-44a1-9a9c-defdaf47336a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:21.044857 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cf4f85e7-3cfa-44a1-9a9c-defdaf47336a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:21.045310 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cf4f85e7-3cfa-44a1-9a9c-defdaf47336a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:21.045726 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cf4f85e7-3cfa-44a1-9a9c-defdaf47336a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:21.173355 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-cf4f85e7-3cfa-44a1-9a9c-defdaf47336a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:21.181231 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-cf4f85e7-3cfa-44a1-9a9c-defdaf47336a tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.148606 Aug 18 14:58:21.181786 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 647/909] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:21 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:58:22.054523 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-dcc5f4b2-48c9-4c4d-b888-51867fe1176a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:22.055186 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-dcc5f4b2-48c9-4c4d-b888-51867fe1176a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:22.061664 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dcc5f4b2-48c9-4c4d-b888-51867fe1176a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:22.062152 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dcc5f4b2-48c9-4c4d-b888-51867fe1176a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:22.062596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dcc5f4b2-48c9-4c4d-b888-51867fe1176a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:22.063287 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dcc5f4b2-48c9-4c4d-b888-51867fe1176a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:22.063768 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dcc5f4b2-48c9-4c4d-b888-51867fe1176a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:22.064197 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dcc5f4b2-48c9-4c4d-b888-51867fe1176a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:22.068321 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:58:22.200494 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-dcc5f4b2-48c9-4c4d-b888-51867fe1176a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:22.209555 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-dcc5f4b2-48c9-4c4d-b888-51867fe1176a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:22.211054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-dcc5f4b2-48c9-4c4d-b888-51867fe1176a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:22.212250 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-dcc5f4b2-48c9-4c4d-b888-51867fe1176a tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1729 microversion: 2.20 time: 0.161657 Aug 18 14:58:22.212814 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 648/910] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:58:22 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:58:22.217264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-265e483f-4db9-4299-9d23-a13701428417 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:22.217877 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-265e483f-4db9-4299-9d23-a13701428417 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:22.225735 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-265e483f-4db9-4299-9d23-a13701428417 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:22.226225 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-265e483f-4db9-4299-9d23-a13701428417 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:22.226664 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-265e483f-4db9-4299-9d23-a13701428417 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:22.227401 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-265e483f-4db9-4299-9d23-a13701428417 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:22.227913 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-265e483f-4db9-4299-9d23-a13701428417 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:22.228449 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-265e483f-4db9-4299-9d23-a13701428417 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:22.362811 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-265e483f-4db9-4299-9d23-a13701428417 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:22.371115 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-265e483f-4db9-4299-9d23-a13701428417 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.157362 Aug 18 14:58:22.371672 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 649/911] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:22 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:58:22.375977 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-6de8c23f-25af-4c32-8d2b-c9294b4755a6 req-0a816436-6a82-488a-9409-c90d05e4f0a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cb0c027-abae-485d-a0b8-c57e5286d2b1", "name": "network-vif-plugged", "status": "completed", "tag": "982d1ea2-1757-4ef9-9f00-9c88adcab716"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:58:22.385501 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-6de8c23f-25af-4c32-8d2b-c9294b4755a6 req-0a816436-6a82-488a-9409-c90d05e4f0a2 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:22.385972 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-6de8c23f-25af-4c32-8d2b-c9294b4755a6 req-0a816436-6a82-488a-9409-c90d05e4f0a2 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:22.386400 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-6de8c23f-25af-4c32-8d2b-c9294b4755a6 req-0a816436-6a82-488a-9409-c90d05e4f0a2 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:22.397663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-6de8c23f-25af-4c32-8d2b-c9294b4755a6 req-0a816436-6a82-488a-9409-c90d05e4f0a2 service nova] Creating event network-vif-plugged:982d1ea2-1757-4ef9-9f00-9c88adcab716 for instance 1cb0c027-abae-485d-a0b8-c57e5286d2b1 on hv-cinder-85220 Aug 18 14:58:22.402675 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-6de8c23f-25af-4c32-8d2b-c9294b4755a6 req-0a816436-6a82-488a-9409-c90d05e4f0a2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029796 Aug 18 14:58:22.403178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 650/912] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:58:23.236346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b481ce83-7d12-4ac5-af94-807a12791757 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:23.237052 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b481ce83-7d12-4ac5-af94-807a12791757 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:23.245231 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b481ce83-7d12-4ac5-af94-807a12791757 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:23.245706 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b481ce83-7d12-4ac5-af94-807a12791757 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:23.246134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b481ce83-7d12-4ac5-af94-807a12791757 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:23.246877 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b481ce83-7d12-4ac5-af94-807a12791757 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:23.247321 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b481ce83-7d12-4ac5-af94-807a12791757 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:23.247762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b481ce83-7d12-4ac5-af94-807a12791757 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:23.381334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b481ce83-7d12-4ac5-af94-807a12791757 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:23.390205 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b481ce83-7d12-4ac5-af94-807a12791757 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:23.391810 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b481ce83-7d12-4ac5-af94-807a12791757 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:23.393168 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b481ce83-7d12-4ac5-af94-807a12791757 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1729 microversion: 2.20 time: 0.161610 Aug 18 14:58:23.393710 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 651/913] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:58:23 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:58:23.398797 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b4993993-25f8-4db5-87b8-19f3c6f2fd0c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:23.399428 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b4993993-25f8-4db5-87b8-19f3c6f2fd0c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:23.405153 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b4993993-25f8-4db5-87b8-19f3c6f2fd0c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:23.405626 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b4993993-25f8-4db5-87b8-19f3c6f2fd0c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:23.406047 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b4993993-25f8-4db5-87b8-19f3c6f2fd0c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:23.406868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b4993993-25f8-4db5-87b8-19f3c6f2fd0c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:23.407292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b4993993-25f8-4db5-87b8-19f3c6f2fd0c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:23.407733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b4993993-25f8-4db5-87b8-19f3c6f2fd0c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:23.537800 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b4993993-25f8-4db5-87b8-19f3c6f2fd0c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:23.545867 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b4993993-25f8-4db5-87b8-19f3c6f2fd0c tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1521 microversion: 2.1 time: 0.151213 Aug 18 14:58:23.546429 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 652/914] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:23 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:58:24.418032 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-32f2d5b3-8711-448d-a5a2-1eb8ec007510 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:24.419059 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-32f2d5b3-8711-448d-a5a2-1eb8ec007510 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:24.426661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-32f2d5b3-8711-448d-a5a2-1eb8ec007510 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:24.428531 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-32f2d5b3-8711-448d-a5a2-1eb8ec007510 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:24.429466 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-32f2d5b3-8711-448d-a5a2-1eb8ec007510 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:24.430182 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-32f2d5b3-8711-448d-a5a2-1eb8ec007510 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:24.430705 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-32f2d5b3-8711-448d-a5a2-1eb8ec007510 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:24.431256 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-32f2d5b3-8711-448d-a5a2-1eb8ec007510 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:24.564982 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-32f2d5b3-8711-448d-a5a2-1eb8ec007510 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:24.573183 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-32f2d5b3-8711-448d-a5a2-1eb8ec007510 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:24.574683 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-32f2d5b3-8711-448d-a5a2-1eb8ec007510 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:24.575857 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-32f2d5b3-8711-448d-a5a2-1eb8ec007510 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1729 microversion: 2.20 time: 0.162612 Aug 18 14:58:24.576411 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 653/915] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:58:24 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:58:24.580645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-0a0d177b-7551-49b4-b689-e4d46a55a193 req-20b0e47e-f166-42f3-b4cd-96a88a31f8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c8904a-619f-4137-9ab6-6231d51327db", "name": "network-vif-deleted", "tag": "15cd7cbd-71f4-4770-84bc-48ea67b25dec"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:58:24.589485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-0a0d177b-7551-49b4-b689-e4d46a55a193 req-20b0e47e-f166-42f3-b4cd-96a88a31f8b8 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:24.590019 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-0a0d177b-7551-49b4-b689-e4d46a55a193 req-20b0e47e-f166-42f3-b4cd-96a88a31f8b8 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:24.590506 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-0a0d177b-7551-49b4-b689-e4d46a55a193 req-20b0e47e-f166-42f3-b4cd-96a88a31f8b8 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:24.601741 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-0a0d177b-7551-49b4-b689-e4d46a55a193 req-20b0e47e-f166-42f3-b4cd-96a88a31f8b8 service nova] Creating event network-vif-deleted:15cd7cbd-71f4-4770-84bc-48ea67b25dec for instance 15c8904a-619f-4137-9ab6-6231d51327db on hv-cinder-85220 Aug 18 14:58:24.606583 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-0a0d177b-7551-49b4-b689-e4d46a55a193 req-20b0e47e-f166-42f3-b4cd-96a88a31f8b8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029039 Aug 18 14:58:24.607150 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 654/916] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:58:24.612029 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5fdb76cf-b73c-46fb-98ef-24e749fa735d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:24.612719 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-5fdb76cf-b73c-46fb-98ef-24e749fa735d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:24.619204 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5fdb76cf-b73c-46fb-98ef-24e749fa735d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:24.619701 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5fdb76cf-b73c-46fb-98ef-24e749fa735d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:24.620135 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5fdb76cf-b73c-46fb-98ef-24e749fa735d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:24.620816 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5fdb76cf-b73c-46fb-98ef-24e749fa735d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:24.621265 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5fdb76cf-b73c-46fb-98ef-24e749fa735d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:24.621688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5fdb76cf-b73c-46fb-98ef-24e749fa735d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:24.683062 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-5fdb76cf-b73c-46fb-98ef-24e749fa735d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:24.690747 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-5fdb76cf-b73c-46fb-98ef-24e749fa735d tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1479 microversion: 2.1 time: 0.082496 Aug 18 14:58:24.691305 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 655/917] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:24 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1479 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:58:25.138759 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a6abe6f1-c12b-4ea3-8299-f54d5bf18826 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:25.139272 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a6abe6f1-c12b-4ea3-8299-f54d5bf18826 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:25.145274 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a6abe6f1-c12b-4ea3-8299-f54d5bf18826 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:25.145790 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a6abe6f1-c12b-4ea3-8299-f54d5bf18826 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:25.146227 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a6abe6f1-c12b-4ea3-8299-f54d5bf18826 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:25.146920 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a6abe6f1-c12b-4ea3-8299-f54d5bf18826 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:25.147377 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a6abe6f1-c12b-4ea3-8299-f54d5bf18826 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:25.147835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a6abe6f1-c12b-4ea3-8299-f54d5bf18826 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:25.228950 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.objects.instance [None req-a6abe6f1-c12b-4ea3-8299-f54d5bf18826 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lazy-loading 'services' on Instance uuid 3b930f52-a56c-4003-b85a-bf2905b6ba86 {{(pid=132268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:58:25.461860 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a6abe6f1-c12b-4ea3-8299-f54d5bf18826 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86/os-volume_attachments/01d1aad6-3b13-44f7-8fa5-9ec06a09f0f3" status: 202 len: 0 microversion: 2.1 time: 0.327118 Aug 18 14:58:25.462494 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 656/918] 10.222.0.36 () {58 vars in 1416 bytes} [Thu Aug 18 14:58:25 2022] DELETE /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86/os-volume_attachments/01d1aad6-3b13-44f7-8fa5-9ec06a09f0f3 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 14:58:25.471021 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-1003d985-abc0-4503-8e21-bd284eeea41d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:25.473376 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-1003d985-abc0-4503-8e21-bd284eeea41d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:25.480128 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1003d985-abc0-4503-8e21-bd284eeea41d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:25.480802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1003d985-abc0-4503-8e21-bd284eeea41d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:25.481349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1003d985-abc0-4503-8e21-bd284eeea41d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:25.482070 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1003d985-abc0-4503-8e21-bd284eeea41d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:25.482518 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1003d985-abc0-4503-8e21-bd284eeea41d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:25.482936 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1003d985-abc0-4503-8e21-bd284eeea41d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:25.514667 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-1003d985-abc0-4503-8e21-bd284eeea41d tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047629 Aug 18 14:58:25.515286 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 657/919] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Aug 18 14:58:25 2022] GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:58:25.598288 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5cacf0c3-9740-441e-98cf-a52bb40b330b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:25.599479 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-5cacf0c3-9740-441e-98cf-a52bb40b330b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:25.605439 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5cacf0c3-9740-441e-98cf-a52bb40b330b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:25.605923 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5cacf0c3-9740-441e-98cf-a52bb40b330b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:25.606353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5cacf0c3-9740-441e-98cf-a52bb40b330b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:25.607036 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5cacf0c3-9740-441e-98cf-a52bb40b330b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:25.607486 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5cacf0c3-9740-441e-98cf-a52bb40b330b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:25.607929 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5cacf0c3-9740-441e-98cf-a52bb40b330b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:25.737332 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-5cacf0c3-9740-441e-98cf-a52bb40b330b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:25.745513 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-5cacf0c3-9740-441e-98cf-a52bb40b330b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:25.747002 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-5cacf0c3-9740-441e-98cf-a52bb40b330b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:25.748238 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-5cacf0c3-9740-441e-98cf-a52bb40b330b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1729 microversion: 2.20 time: 0.153691 Aug 18 14:58:25.748814 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 658/920] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:58:25 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:58:25.753511 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-29cef8e3-3f8c-4869-9be4-74b1efe83514 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:25.754127 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-29cef8e3-3f8c-4869-9be4-74b1efe83514 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:25.760305 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-29cef8e3-3f8c-4869-9be4-74b1efe83514 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:25.760790 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-29cef8e3-3f8c-4869-9be4-74b1efe83514 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:25.761225 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-29cef8e3-3f8c-4869-9be4-74b1efe83514 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:25.761910 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-29cef8e3-3f8c-4869-9be4-74b1efe83514 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:25.762362 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-29cef8e3-3f8c-4869-9be4-74b1efe83514 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:25.762783 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-29cef8e3-3f8c-4869-9be4-74b1efe83514 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:25.796771 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-29cef8e3-3f8c-4869-9be4-74b1efe83514 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:25.797257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-29cef8e3-3f8c-4869-9be4-74b1efe83514 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:25.797688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-29cef8e3-3f8c-4869-9be4-74b1efe83514 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:25.798130 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.objects.instance [None req-29cef8e3-3f8c-4869-9be4-74b1efe83514 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lazy-loading 'fault' on Instance uuid 15c8904a-619f-4137-9ab6-6231d51327db {{(pid=132268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:58:25.844071 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-29cef8e3-3f8c-4869-9be4-74b1efe83514 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26eaa7f102bd41028983458ae48ff992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc902aa109c4d7291c0bab62f80048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:25.852658 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-29cef8e3-3f8c-4869-9be4-74b1efe83514 tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 200 len: 1312 microversion: 2.1 time: 0.102541 Aug 18 14:58:25.853576 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 659/921] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:25 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:58:26.530116 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ae83bb33-02ec-444a-9148-759c3ade4693 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:26.533232 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ae83bb33-02ec-444a-9148-759c3ade4693 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:26.540861 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ae83bb33-02ec-444a-9148-759c3ade4693 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:26.541346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ae83bb33-02ec-444a-9148-759c3ade4693 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:26.541832 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ae83bb33-02ec-444a-9148-759c3ade4693 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:26.542602 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ae83bb33-02ec-444a-9148-759c3ade4693 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:26.543056 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ae83bb33-02ec-444a-9148-759c3ade4693 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:26.543479 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ae83bb33-02ec-444a-9148-759c3ade4693 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:26.572866 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-ae83bb33-02ec-444a-9148-759c3ade4693 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047782 Aug 18 14:58:26.573445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 660/922] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Aug 18 14:58:26 2022] GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:58:26.774439 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-775432ec-26da-46ae-9ba2-01d95c3af740 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:26.775072 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-775432ec-26da-46ae-9ba2-01d95c3af740 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:26.781023 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-775432ec-26da-46ae-9ba2-01d95c3af740 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:26.781500 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-775432ec-26da-46ae-9ba2-01d95c3af740 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:26.781927 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-775432ec-26da-46ae-9ba2-01d95c3af740 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:26.782609 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-775432ec-26da-46ae-9ba2-01d95c3af740 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:26.783056 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-775432ec-26da-46ae-9ba2-01d95c3af740 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:26.783473 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-775432ec-26da-46ae-9ba2-01d95c3af740 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:26.917470 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-775432ec-26da-46ae-9ba2-01d95c3af740 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:26.925972 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-775432ec-26da-46ae-9ba2-01d95c3af740 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:26.927478 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-775432ec-26da-46ae-9ba2-01d95c3af740 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:26.928693 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-775432ec-26da-46ae-9ba2-01d95c3af740 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1716 microversion: 2.20 time: 0.158165 Aug 18 14:58:26.929259 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 661/923] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:58:26 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1716 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:58:26.933780 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b0d7d232-98d6-44d5-8174-45e699891fec tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:26.934399 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b0d7d232-98d6-44d5-8174-45e699891fec tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] [instance: 15c8904a-619f-4137-9ab6-6231d51327db] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:26.941694 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b0d7d232-98d6-44d5-8174-45e699891fec tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:26.942827 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b0d7d232-98d6-44d5-8174-45e699891fec tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:26.943548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b0d7d232-98d6-44d5-8174-45e699891fec tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:26.944352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b0d7d232-98d6-44d5-8174-45e699891fec tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:26.944975 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b0d7d232-98d6-44d5-8174-45e699891fec tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:26.945409 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b0d7d232-98d6-44d5-8174-45e699891fec tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:26.960953 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-b0d7d232-98d6-44d5-8174-45e699891fec tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] HTTP exception thrown: Instance 15c8904a-619f-4137-9ab6-6231d51327db could not be found. Aug 18 14:58:26.962545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b0d7d232-98d6-44d5-8174-45e699891fec tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Request method failure captured: Aug 18 14:58:26.962545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db HTTP/1.1 Aug 18 14:58:26.962545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:58:26.962545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:58:26.962545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:58:26.962545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:58:26.962545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:58:26.962545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:58:26.962545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:58:26.962545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:58:26.962545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lJQwK2c115bNCfI9_4SFNLkllfgSZr5El1eNqitr3OQtjGAEW-PK-gbdLreyn40k786Z-SK2YhgyrUV5WJGnNRJIEHwtBu_7UfQYOE30KQE3ki2AOXsYaAaQyEq_0p9RnrNtYTZZ5VHW9FG03qMbGgeDDQs-wc6W0Yv5SdnYB7CjZs Aug 18 14:58:26.962545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:58:26.962545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:58:26.962545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:58:26.962545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:58:26.962545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:58:26.962545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:58:26.962545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: acc902aa109c4d7291c0bab62f80048e Aug 18 14:58:26.962545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1560225051 Aug 18 14:58:26.962545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:58:26.962545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:58:26.964174 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/acc902aa109c4d7291c0bab62f80048e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/acc902aa109c4d7291c0bab62f80048e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_acc902aa109c4d7291c0bab62f80048e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/acc902aa109c4d7291c0bab62f80048e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:58:26.964174 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1560225051 Aug 18 14:58:26.964174 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: acc902aa109c4d7291c0bab62f80048e Aug 18 14:58:26.964174 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1560225051 Aug 18 14:58:26.964174 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-ServerRescueNegativeTestJSON-1560225051-project Aug 18 14:58:26.964174 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:58:26.964174 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:58:26.964174 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 26eaa7f102bd41028983458ae48ff992 Aug 18 14:58:26.964174 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1560225051-project Aug 18 14:58:26.964174 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:58:26.964174 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 15c8904a-619f-4137-9ab6-6231d51327db could not be found. Aug 18 14:58:26.964174 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '15c8904a-619f-4137-9ab6-6231d51327db'} Aug 18 14:58:26.965044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:58:26.965044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:26.965044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:58:26.965044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:58:26.965044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:58:26.965044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:58:26.965044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:58:26.965044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:58:26.965044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:58:26.965044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:58:26.965044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15c8904a-619f-4137-9ab6-6231d51327db could not be found. Aug 18 14:58:26.965044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:26.965044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:26.965044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:26.965044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:26.965044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:26.965044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:26.965044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:58:26.965044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:58:26.965044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:58:26.966346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:58:26.966346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:58:26.966346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:58:26.966346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:58:26.966346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:58:26.966346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:58:26.966346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:58:26.966346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15c8904a-619f-4137-9ab6-6231d51327db could not be found. Aug 18 14:58:26.966346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:26.966346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:26.966346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:26.966346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:26.966346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:26.966346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:26.966346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:58:26.966346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:58:26.966346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15c8904a-619f-4137-9ab6-6231d51327db could not be found. Aug 18 14:58:26.966346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:26.967804 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b0d7d232-98d6-44d5-8174-45e699891fec tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] Returning 404 to user: Instance 15c8904a-619f-4137-9ab6-6231d51327db could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:58:26.967804 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b0d7d232-98d6-44d5-8174-45e699891fec tempest-ServerRescueNegativeTestJSON-1560225051 tempest-ServerRescueNegativeTestJSON-1560225051-project] 10.222.0.36 "GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db" status: 404 len: 111 microversion: 2.1 time: 0.033747 Aug 18 14:58:26.967804 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 662/924] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:26 2022] GET /compute/v2.1/servers/15c8904a-619f-4137-9ab6-6231d51327db => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:58:27.077207 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-342f19a2-5066-46c2-9195-73db7d833630 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:27.079445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-342f19a2-5066-46c2-9195-73db7d833630 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:27.085495 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-342f19a2-5066-46c2-9195-73db7d833630 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:27.085986 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-342f19a2-5066-46c2-9195-73db7d833630 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:27.086425 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-342f19a2-5066-46c2-9195-73db7d833630 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:27.087121 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-342f19a2-5066-46c2-9195-73db7d833630 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:27.087574 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-342f19a2-5066-46c2-9195-73db7d833630 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:27.088023 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-342f19a2-5066-46c2-9195-73db7d833630 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:27.118647 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-342f19a2-5066-46c2-9195-73db7d833630 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047551 Aug 18 14:58:27.119217 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 663/925] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Aug 18 14:58:27 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 14:58:27.233410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-54012ac8-be9a-42a6-90cb-bf8ccc9d3d51 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:27.235874 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-54012ac8-be9a-42a6-90cb-bf8ccc9d3d51 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:27.241986 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-54012ac8-be9a-42a6-90cb-bf8ccc9d3d51 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:27.242540 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-54012ac8-be9a-42a6-90cb-bf8ccc9d3d51 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:27.243038 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-54012ac8-be9a-42a6-90cb-bf8ccc9d3d51 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:27.243869 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-54012ac8-be9a-42a6-90cb-bf8ccc9d3d51 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:27.244406 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-54012ac8-be9a-42a6-90cb-bf8ccc9d3d51 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:27.244944 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-54012ac8-be9a-42a6-90cb-bf8ccc9d3d51 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:27.275657 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-54012ac8-be9a-42a6-90cb-bf8ccc9d3d51 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046236 Aug 18 14:58:27.276355 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 664/926] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Aug 18 14:58:27 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 14:58:27.344175 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-be8ccc6a-dc29-4dab-99d7-639333f9744d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:27.344692 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-be8ccc6a-dc29-4dab-99d7-639333f9744d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:27.351949 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-be8ccc6a-dc29-4dab-99d7-639333f9744d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:27.352444 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-be8ccc6a-dc29-4dab-99d7-639333f9744d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:27.352878 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-be8ccc6a-dc29-4dab-99d7-639333f9744d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:27.353582 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-be8ccc6a-dc29-4dab-99d7-639333f9744d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:27.354034 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-be8ccc6a-dc29-4dab-99d7-639333f9744d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:27.354455 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-be8ccc6a-dc29-4dab-99d7-639333f9744d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:27.396177 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-be8ccc6a-dc29-4dab-99d7-639333f9744d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Going to try to terminate instance {{(pid=132268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:58:27.399247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:58:27.474518 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-be8ccc6a-dc29-4dab-99d7-639333f9744d tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303" status: 204 len: 0 microversion: 2.1 time: 0.133365 Aug 18 14:58:27.475365 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 665/927] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 14:58:27 2022] DELETE /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 14:58:27.486471 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-32c8aeb3-2667-483e-ac18-0eb6c27a6a05 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:27.487171 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-32c8aeb3-2667-483e-ac18-0eb6c27a6a05 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:27.493638 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-32c8aeb3-2667-483e-ac18-0eb6c27a6a05 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:27.494116 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-32c8aeb3-2667-483e-ac18-0eb6c27a6a05 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:27.494543 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-32c8aeb3-2667-483e-ac18-0eb6c27a6a05 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:27.495235 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-32c8aeb3-2667-483e-ac18-0eb6c27a6a05 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:27.495705 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-32c8aeb3-2667-483e-ac18-0eb6c27a6a05 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:27.496178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-32c8aeb3-2667-483e-ac18-0eb6c27a6a05 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:27.993802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-32c8aeb3-2667-483e-ac18-0eb6c27a6a05 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:28.001429 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-32c8aeb3-2667-483e-ac18-0eb6c27a6a05 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303" status: 200 len: 1674 microversion: 2.1 time: 0.521417 Aug 18 14:58:28.002104 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 666/928] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:27 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303 => generated 1674 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:58:28.007311 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-56af45cc-fece-431c-af09-ea8593f77fdf tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:28.009559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-56af45cc-fece-431c-af09-ea8593f77fdf tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:28.016182 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-56af45cc-fece-431c-af09-ea8593f77fdf tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:28.016655 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-56af45cc-fece-431c-af09-ea8593f77fdf tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:28.017086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-56af45cc-fece-431c-af09-ea8593f77fdf tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:28.017874 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-56af45cc-fece-431c-af09-ea8593f77fdf tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:28.018322 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-56af45cc-fece-431c-af09-ea8593f77fdf tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:28.018741 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-56af45cc-fece-431c-af09-ea8593f77fdf tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:28.047903 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-56af45cc-fece-431c-af09-ea8593f77fdf tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044742 Aug 18 14:58:28.048648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 667/929] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Aug 18 14:58:28 2022] GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 14:58:28.112367 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0013586d-89c0-448a-ae28-5eaa8868039c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:28.112878 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0013586d-89c0-448a-ae28-5eaa8868039c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:28.118840 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0013586d-89c0-448a-ae28-5eaa8868039c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:28.119329 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0013586d-89c0-448a-ae28-5eaa8868039c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:28.119793 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0013586d-89c0-448a-ae28-5eaa8868039c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:28.120499 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0013586d-89c0-448a-ae28-5eaa8868039c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:28.120953 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0013586d-89c0-448a-ae28-5eaa8868039c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:28.121384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0013586d-89c0-448a-ae28-5eaa8868039c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:28.149795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0013586d-89c0-448a-ae28-5eaa8868039c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Going to try to terminate instance {{(pid=132268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:58:28.229541 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0013586d-89c0-448a-ae28-5eaa8868039c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86" status: 204 len: 0 microversion: 2.1 time: 0.120798 Aug 18 14:58:28.230132 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 668/930] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 14:58:28 2022] DELETE /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 14:58:28.238618 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5450c96d-d68d-4133-bebb-22f36e782bda tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:28.239389 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-5450c96d-d68d-4133-bebb-22f36e782bda tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:28.245295 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5450c96d-d68d-4133-bebb-22f36e782bda tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:28.245768 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5450c96d-d68d-4133-bebb-22f36e782bda tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:28.246193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5450c96d-d68d-4133-bebb-22f36e782bda tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:28.246871 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5450c96d-d68d-4133-bebb-22f36e782bda tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:28.247315 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5450c96d-d68d-4133-bebb-22f36e782bda tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:28.247755 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5450c96d-d68d-4133-bebb-22f36e782bda tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:28.432097 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-5450c96d-d68d-4133-bebb-22f36e782bda tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:28.440380 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-5450c96d-d68d-4133-bebb-22f36e782bda tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86" status: 200 len: 1682 microversion: 2.1 time: 0.205705 Aug 18 14:58:28.440954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 669/931] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:28 2022] GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86 => generated 1682 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:58:29.024497 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-543909f1-0db8-4bdf-a0ca-60fb60d1ba17 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:29.025163 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-543909f1-0db8-4bdf-a0ca-60fb60d1ba17 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:29.032031 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-543909f1-0db8-4bdf-a0ca-60fb60d1ba17 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:29.032820 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-543909f1-0db8-4bdf-a0ca-60fb60d1ba17 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:29.033366 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-543909f1-0db8-4bdf-a0ca-60fb60d1ba17 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:29.034375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-543909f1-0db8-4bdf-a0ca-60fb60d1ba17 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:29.034904 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-543909f1-0db8-4bdf-a0ca-60fb60d1ba17 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:29.035431 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-543909f1-0db8-4bdf-a0ca-60fb60d1ba17 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:29.237855 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-543909f1-0db8-4bdf-a0ca-60fb60d1ba17 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:29.246608 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-543909f1-0db8-4bdf-a0ca-60fb60d1ba17 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303" status: 200 len: 1674 microversion: 2.1 time: 0.226962 Aug 18 14:58:29.247176 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 670/932] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:29 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303 => generated 1674 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:58:29.464367 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ab680b3a-4752-4f09-82c6-6491db2c9827 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:29.464367 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ab680b3a-4752-4f09-82c6-6491db2c9827 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:29.470897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ab680b3a-4752-4f09-82c6-6491db2c9827 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:29.471388 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ab680b3a-4752-4f09-82c6-6491db2c9827 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:29.471848 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ab680b3a-4752-4f09-82c6-6491db2c9827 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:29.472553 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ab680b3a-4752-4f09-82c6-6491db2c9827 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:29.473006 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ab680b3a-4752-4f09-82c6-6491db2c9827 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:29.473456 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ab680b3a-4752-4f09-82c6-6491db2c9827 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:29.694809 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ab680b3a-4752-4f09-82c6-6491db2c9827 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:29.702916 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-ab680b3a-4752-4f09-82c6-6491db2c9827 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86" status: 200 len: 1682 microversion: 2.1 time: 0.244044 Aug 18 14:58:29.703496 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 671/933] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:29 2022] GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86 => generated 1682 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:58:30.269428 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8dc325da-7c0f-49cf-a317-620b249be3f7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:30.270093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-8dc325da-7c0f-49cf-a317-620b249be3f7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:30.288670 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8dc325da-7c0f-49cf-a317-620b249be3f7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:30.289372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8dc325da-7c0f-49cf-a317-620b249be3f7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:30.291324 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8dc325da-7c0f-49cf-a317-620b249be3f7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:30.291573 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8dc325da-7c0f-49cf-a317-620b249be3f7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:30.292030 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8dc325da-7c0f-49cf-a317-620b249be3f7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:30.292453 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8dc325da-7c0f-49cf-a317-620b249be3f7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:30.460546 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8dc325da-7c0f-49cf-a317-620b249be3f7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:30.468315 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-8dc325da-7c0f-49cf-a317-620b249be3f7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303" status: 200 len: 1674 microversion: 2.1 time: 0.202978 Aug 18 14:58:30.480269 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 672/934] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:30 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303 => generated 1674 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:58:30.725082 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-970545f0-4ea9-4c42-b67b-9a9546c245c8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:30.726059 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-970545f0-4ea9-4c42-b67b-9a9546c245c8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:30.729545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:58:30.736461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-970545f0-4ea9-4c42-b67b-9a9546c245c8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:30.737670 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-970545f0-4ea9-4c42-b67b-9a9546c245c8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:30.738428 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-970545f0-4ea9-4c42-b67b-9a9546c245c8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:30.739659 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-970545f0-4ea9-4c42-b67b-9a9546c245c8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:30.740424 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-970545f0-4ea9-4c42-b67b-9a9546c245c8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:30.740855 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-970545f0-4ea9-4c42-b67b-9a9546c245c8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:30.909731 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-970545f0-4ea9-4c42-b67b-9a9546c245c8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:30.918466 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-970545f0-4ea9-4c42-b67b-9a9546c245c8 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86" status: 200 len: 1682 microversion: 2.1 time: 0.198019 Aug 18 14:58:30.926102 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 673/935] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:30 2022] GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86 => generated 1682 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:58:31.491098 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-13ac9f6f-808b-412f-b371-ae2c5a8caa2b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:31.491792 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-13ac9f6f-808b-412f-b371-ae2c5a8caa2b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:31.498561 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-13ac9f6f-808b-412f-b371-ae2c5a8caa2b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:31.499003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-13ac9f6f-808b-412f-b371-ae2c5a8caa2b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:31.499440 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-13ac9f6f-808b-412f-b371-ae2c5a8caa2b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:31.500181 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-13ac9f6f-808b-412f-b371-ae2c5a8caa2b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:31.500825 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-13ac9f6f-808b-412f-b371-ae2c5a8caa2b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:31.501244 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-13ac9f6f-808b-412f-b371-ae2c5a8caa2b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:31.834476 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-13ac9f6f-808b-412f-b371-ae2c5a8caa2b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:31.842551 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-13ac9f6f-808b-412f-b371-ae2c5a8caa2b tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303" status: 200 len: 1674 microversion: 2.1 time: 0.355992 Aug 18 14:58:31.843137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 674/936] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:31 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303 => generated 1674 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:58:31.972647 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-1deaf406-d9ba-42f8-a534-4ff5909c92f9 tempest-VolumesGetTestJSON-35079833 tempest-VolumesGetTestJSON-35079833-project] Action: 'create', calling method: .version_select at 0x7fb21437faf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1733101393", "metadata": {"Type": "work"}}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:58:32.304378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-1deaf406-d9ba-42f8-a534-4ff5909c92f9 tempest-VolumesGetTestJSON-35079833 tempest-VolumesGetTestJSON-35079833-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.459563 Aug 18 14:58:32.312200 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 675/937] 10.222.0.36 () {60 vars in 1156 bytes} [Thu Aug 18 14:58:31 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 462 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 18 14:58:32.316632 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2a3bb8cf-50bd-4737-ab62-84b2c232c17c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:32.317563 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2a3bb8cf-50bd-4737-ab62-84b2c232c17c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:32.325302 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2a3bb8cf-50bd-4737-ab62-84b2c232c17c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:32.328369 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2a3bb8cf-50bd-4737-ab62-84b2c232c17c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:32.329249 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2a3bb8cf-50bd-4737-ab62-84b2c232c17c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:32.330448 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2a3bb8cf-50bd-4737-ab62-84b2c232c17c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:32.331177 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2a3bb8cf-50bd-4737-ab62-84b2c232c17c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:32.331830 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2a3bb8cf-50bd-4737-ab62-84b2c232c17c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:32.676307 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2a3bb8cf-50bd-4737-ab62-84b2c232c17c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:32.685865 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2a3bb8cf-50bd-4737-ab62-84b2c232c17c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86" status: 200 len: 1682 microversion: 2.1 time: 0.379245 Aug 18 14:58:32.686442 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 676/938] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:32 2022] GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86 => generated 1682 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:58:32.690923 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b4958ee6-b504-402e-8a2e-c7cc9245f5ae tempest-VolumesGetTestJSON-35079833 tempest-VolumesGetTestJSON-35079833-project] Calling method '.version_select at 0x7fb214357700>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:32.743007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b4958ee6-b504-402e-8a2e-c7cc9245f5ae tempest-VolumesGetTestJSON-35079833 tempest-VolumesGetTestJSON-35079833-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/51c74ea1-a8ac-4afd-bf1f-7ca4a9ca6434" status: 200 len: 354 microversion: 2.1 time: 0.055499 Aug 18 14:58:32.743635 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 677/939] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Aug 18 14:58:32 2022] GET /compute/v2.1/os-volumes/51c74ea1-a8ac-4afd-bf1f-7ca4a9ca6434 => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:58:32.756318 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-447ed0bd-5e99-42b0-a19d-22eaa6abd238 tempest-VolumesGetTestJSON-35079833 tempest-VolumesGetTestJSON-35079833-project] Calling method '.version_select at 0x7fb21437fb80>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:32.803998 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-447ed0bd-5e99-42b0-a19d-22eaa6abd238 tempest-VolumesGetTestJSON-35079833 tempest-VolumesGetTestJSON-35079833-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/51c74ea1-a8ac-4afd-bf1f-7ca4a9ca6434" status: 200 len: 354 microversion: 2.1 time: 0.051872 Aug 18 14:58:32.804648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 678/940] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Aug 18 14:58:32 2022] GET /compute/v2.1/os-volumes/51c74ea1-a8ac-4afd-bf1f-7ca4a9ca6434 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:58:32.822579 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b06cf44e-479e-4b3c-a145-937e7e7fe869 tempest-VolumesGetTestJSON-35079833 tempest-VolumesGetTestJSON-35079833-project] Calling method '.version_select at 0x7fb21437f8b0>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:32.915648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b06cf44e-479e-4b3c-a145-937e7e7fe869 tempest-VolumesGetTestJSON-35079833 tempest-VolumesGetTestJSON-35079833-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/51c74ea1-a8ac-4afd-bf1f-7ca4a9ca6434" status: 202 len: 0 microversion: 2.1 time: 0.096752 Aug 18 14:58:32.916558 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 679/941] 10.222.0.36 () {58 vars in 1248 bytes} [Thu Aug 18 14:58:32 2022] DELETE /compute/v2.1/os-volumes/51c74ea1-a8ac-4afd-bf1f-7ca4a9ca6434 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 14:58:32.924415 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e9f1dc04-cd51-4782-9ef8-7668a051fda7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:32.925573 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e9f1dc04-cd51-4782-9ef8-7668a051fda7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:32.936552 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e9f1dc04-cd51-4782-9ef8-7668a051fda7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:32.938150 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e9f1dc04-cd51-4782-9ef8-7668a051fda7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:32.938753 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e9f1dc04-cd51-4782-9ef8-7668a051fda7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:32.942890 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e9f1dc04-cd51-4782-9ef8-7668a051fda7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:32.943544 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e9f1dc04-cd51-4782-9ef8-7668a051fda7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:32.944906 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e9f1dc04-cd51-4782-9ef8-7668a051fda7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:33.058288 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e9f1dc04-cd51-4782-9ef8-7668a051fda7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:33.067229 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e9f1dc04-cd51-4782-9ef8-7668a051fda7 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303" status: 200 len: 1607 microversion: 2.1 time: 0.149219 Aug 18 14:58:33.067935 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 680/942] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:32 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303 => generated 1607 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:58:33.073102 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-fa16419b-c42e-4261-8cbf-894412e7a5e7 tempest-VolumesGetTestJSON-35079833 tempest-VolumesGetTestJSON-35079833-project] Calling method '.version_select at 0x7fb21432e5e0>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:33.134346 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-fa16419b-c42e-4261-8cbf-894412e7a5e7 tempest-VolumesGetTestJSON-35079833 tempest-VolumesGetTestJSON-35079833-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/51c74ea1-a8ac-4afd-bf1f-7ca4a9ca6434" status: 200 len: 353 microversion: 2.1 time: 0.065126 Aug 18 14:58:33.134916 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 681/943] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Aug 18 14:58:33 2022] GET /compute/v2.1/os-volumes/51c74ea1-a8ac-4afd-bf1f-7ca4a9ca6434 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:58:33.468675 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-67f596fa-4438-49b8-8021-82396b0b7d34 req-83bdf529-c65a-4da2-8c95-4a3d51d17b7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b930f52-a56c-4003-b85a-bf2905b6ba86", "name": "network-vif-deleted", "tag": "173256a4-b50a-40ae-8f25-84e06b5fe723"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:58:33.486028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-67f596fa-4438-49b8-8021-82396b0b7d34 req-83bdf529-c65a-4da2-8c95-4a3d51d17b7a service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:33.486503 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-67f596fa-4438-49b8-8021-82396b0b7d34 req-83bdf529-c65a-4da2-8c95-4a3d51d17b7a service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:33.490224 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-67f596fa-4438-49b8-8021-82396b0b7d34 req-83bdf529-c65a-4da2-8c95-4a3d51d17b7a service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:33.507537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-67f596fa-4438-49b8-8021-82396b0b7d34 req-83bdf529-c65a-4da2-8c95-4a3d51d17b7a service nova] Creating event network-vif-deleted:173256a4-b50a-40ae-8f25-84e06b5fe723 for instance 3b930f52-a56c-4003-b85a-bf2905b6ba86 on hv-cinder-85220 Aug 18 14:58:33.512789 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-67f596fa-4438-49b8-8021-82396b0b7d34 req-83bdf529-c65a-4da2-8c95-4a3d51d17b7a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057580 Aug 18 14:58:33.514528 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 682/944] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:58:33.708771 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-9e783e35-32dc-4d5b-a98b-62508356911f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:33.709490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-9e783e35-32dc-4d5b-a98b-62508356911f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:33.716321 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9e783e35-32dc-4d5b-a98b-62508356911f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:33.716809 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9e783e35-32dc-4d5b-a98b-62508356911f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:33.717256 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9e783e35-32dc-4d5b-a98b-62508356911f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:33.717991 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9e783e35-32dc-4d5b-a98b-62508356911f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:33.718394 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9e783e35-32dc-4d5b-a98b-62508356911f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:33.719096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9e783e35-32dc-4d5b-a98b-62508356911f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:33.754968 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9e783e35-32dc-4d5b-a98b-62508356911f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:33.755352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9e783e35-32dc-4d5b-a98b-62508356911f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:33.755816 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9e783e35-32dc-4d5b-a98b-62508356911f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:33.756264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.objects.instance [None req-9e783e35-32dc-4d5b-a98b-62508356911f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lazy-loading 'fault' on Instance uuid 3b930f52-a56c-4003-b85a-bf2905b6ba86 {{(pid=132268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:58:33.804350 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-9e783e35-32dc-4d5b-a98b-62508356911f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dbc938bcd741f2a2b2013b6aa6f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9fe0cbbfa47bca81668c039afc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:33.812198 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-9e783e35-32dc-4d5b-a98b-62508356911f tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86" status: 200 len: 1331 microversion: 2.1 time: 0.108612 Aug 18 14:58:33.819774 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 683/945] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:33 2022] GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86 => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:58:34.089410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-54e49f20-2d0e-4375-9528-4d194d82c6bf tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:34.090030 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-54e49f20-2d0e-4375-9528-4d194d82c6bf tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:34.096223 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-54e49f20-2d0e-4375-9528-4d194d82c6bf tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:34.096709 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-54e49f20-2d0e-4375-9528-4d194d82c6bf tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:34.097147 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-54e49f20-2d0e-4375-9528-4d194d82c6bf tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:34.097851 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-54e49f20-2d0e-4375-9528-4d194d82c6bf tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:34.098302 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-54e49f20-2d0e-4375-9528-4d194d82c6bf tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:34.099294 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-54e49f20-2d0e-4375-9528-4d194d82c6bf tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:34.121435 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:58:34.137185 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-54e49f20-2d0e-4375-9528-4d194d82c6bf tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:34.137667 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-54e49f20-2d0e-4375-9528-4d194d82c6bf tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:34.138358 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-54e49f20-2d0e-4375-9528-4d194d82c6bf tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:34.138812 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.objects.instance [None req-54e49f20-2d0e-4375-9528-4d194d82c6bf tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lazy-loading 'fault' on Instance uuid 0587b3b6-bb0f-443b-8b28-0035ad738303 {{(pid=132268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:58:34.185427 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-54e49f20-2d0e-4375-9528-4d194d82c6bf tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d96208474754b2381d769d807689bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde4e338430442449fcc203cd9493bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:58:34.194213 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-54e49f20-2d0e-4375-9528-4d194d82c6bf tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303" status: 200 len: 1328 microversion: 2.1 time: 0.108677 Aug 18 14:58:34.194869 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 684/946] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:34 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303 => generated 1328 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:58:34.200678 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-87d71890-e046-4a7c-a88d-7ae27aa4ee7a tempest-VolumesGetTestJSON-35079833 tempest-VolumesGetTestJSON-35079833-project] Calling method '.version_select at 0x7fb2143dba60>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:34.236554 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-87d71890-e046-4a7c-a88d-7ae27aa4ee7a tempest-VolumesGetTestJSON-35079833 tempest-VolumesGetTestJSON-35079833-project] HTTP exception thrown: Volume 51c74ea1-a8ac-4afd-bf1f-7ca4a9ca6434 could not be found. Aug 18 14:58:34.240443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-87d71890-e046-4a7c-a88d-7ae27aa4ee7a tempest-VolumesGetTestJSON-35079833 tempest-VolumesGetTestJSON-35079833-project] Request method failure captured: Aug 18 14:58:34.240443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/os-volumes/51c74ea1-a8ac-4afd-bf1f-7ca4a9ca6434 HTTP/1.1 Aug 18 14:58:34.240443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:58:34.240443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:58:34.240443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:58:34.240443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:58:34.240443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:58:34.240443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:58:34.240443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:58:34.240443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:58:34.240443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lOXxhzVLxYWNqQIbthnxQol_1qCbPjLvuDS6jqmm-ms04rcVgbQ4nCcUyUueSBWj_VpUmkzXm1a8tX5Tv8xzW7VpdW8grFZ2keDmEQ9h9Vy3rWFsPY1SMzex-ya1pEBwRIh8CRuuw3AIdsOhR0yqj01L7_BUCT2kJBCHF2RVICA6UM Aug 18 14:58:34.240443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:58:34.240443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:58:34.240443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:58:34.240443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:58:34.240443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:58:34.240443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:58:34.240443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: ecaae864012243ecb812d5d71174e1a7 Aug 18 14:58:34.240443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-VolumesGetTestJSON-35079833 Aug 18 14:58:34.240443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:58:34.240443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:58:34.241996 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ecaae864012243ecb812d5d71174e1a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ecaae864012243ecb812d5d71174e1a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ecaae864012243ecb812d5d71174e1a7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ecaae864012243ecb812d5d71174e1a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:58:34.241996 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-VolumesGetTestJSON-35079833 Aug 18 14:58:34.241996 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: ecaae864012243ecb812d5d71174e1a7 Aug 18 14:58:34.241996 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-VolumesGetTestJSON-35079833 Aug 18 14:58:34.241996 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-VolumesGetTestJSON-35079833-project Aug 18 14:58:34.241996 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:58:34.241996 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:58:34.241996 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 331b75a7abac43a7a00aa29f94a19c63 Aug 18 14:58:34.241996 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-VolumesGetTestJSON-35079833-project Aug 18 14:58:34.241996 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: Aug 18 14:58:34.241996 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Volume 51c74ea1-a8ac-4afd-bf1f-7ca4a9ca6434 could not be found. Aug 18 14:58:34.241996 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '51c74ea1-a8ac-4afd-bf1f-7ca4a9ca6434'} Aug 18 14:58:34.241996 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:58:34.243093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:34.243093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:58:34.243093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:58:34.243093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 14:58:34.243093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 14:58:34.243093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 14:58:34.243093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 14:58:34.243093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 14:58:34.243093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 14:58:34.243093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 14:58:34.243093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 14:58:34.243093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:58:34.243093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:58:34.243093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:58:34.243093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:58:34.243093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 51c74ea1-a8ac-4afd-bf1f-7ca4a9ca6434 could not be found. (HTTP 404) (Request-ID: req-a3cf8468-69c4-4f9e-9183-ec9a201be407) Aug 18 14:58:34.243093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:34.243093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:34.243093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:34.244490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:34.244490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 14:58:34.244490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 14:58:34.244490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 14:58:34.244490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 14:58:34.244490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 14:58:34.244490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 14:58:34.244490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 14:58:34.244490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 14:58:34.244490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:58:34.244490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:58:34.244490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 14:58:34.244490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 14:58:34.244490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 14:58:34.244490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 14:58:34.244490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 14:58:34.244490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 14:58:34.244490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 14:58:34.244490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 14:58:34.245835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:58:34.245835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:58:34.245835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:58:34.245835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:58:34.245835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 51c74ea1-a8ac-4afd-bf1f-7ca4a9ca6434 could not be found. Aug 18 14:58:34.245835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:34.245835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:34.245835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:34.245835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:34.245835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:34.245835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:34.245835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:58:34.245835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:58:34.245835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 14:58:34.245835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 14:58:34.245835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:58:34.245835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:58:34.245835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 14:58:34.245835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:58:34.247176 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 51c74ea1-a8ac-4afd-bf1f-7ca4a9ca6434 could not be found. Aug 18 14:58:34.247176 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:34.247176 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:34.247176 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:34.247176 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:34.247176 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:34.247176 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:34.247176 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:58:34.247176 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:58:34.247176 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 51c74ea1-a8ac-4afd-bf1f-7ca4a9ca6434 could not be found. Aug 18 14:58:34.247176 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:34.250112 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-87d71890-e046-4a7c-a88d-7ae27aa4ee7a tempest-VolumesGetTestJSON-35079833 tempest-VolumesGetTestJSON-35079833-project] Returning 404 to user: Volume 51c74ea1-a8ac-4afd-bf1f-7ca4a9ca6434 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:58:34.250112 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-87d71890-e046-4a7c-a88d-7ae27aa4ee7a tempest-VolumesGetTestJSON-35079833 tempest-VolumesGetTestJSON-35079833-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/51c74ea1-a8ac-4afd-bf1f-7ca4a9ca6434" status: 404 len: 109 microversion: 2.1 time: 0.053524 Aug 18 14:58:34.250112 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 685/947] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Aug 18 14:58:34 2022] GET /compute/v2.1/os-volumes/51c74ea1-a8ac-4afd-bf1f-7ca4a9ca6434 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:58:34.832570 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-37537d6b-4cb8-4ac3-9c13-85fc3c469835 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:34.834763 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-37537d6b-4cb8-4ac3-9c13-85fc3c469835 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:34.842828 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-37537d6b-4cb8-4ac3-9c13-85fc3c469835 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:34.843316 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-37537d6b-4cb8-4ac3-9c13-85fc3c469835 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:34.843777 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-37537d6b-4cb8-4ac3-9c13-85fc3c469835 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:34.844479 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-37537d6b-4cb8-4ac3-9c13-85fc3c469835 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:34.845236 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-37537d6b-4cb8-4ac3-9c13-85fc3c469835 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:34.845673 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-37537d6b-4cb8-4ac3-9c13-85fc3c469835 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:34.863082 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-37537d6b-4cb8-4ac3-9c13-85fc3c469835 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] HTTP exception thrown: Instance 3b930f52-a56c-4003-b85a-bf2905b6ba86 could not be found. Aug 18 14:58:34.864720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-37537d6b-4cb8-4ac3-9c13-85fc3c469835 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Request method failure captured: Aug 18 14:58:34.864720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86 HTTP/1.1 Aug 18 14:58:34.864720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:58:34.864720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:58:34.864720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:58:34.864720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:58:34.864720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:58:34.864720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:58:34.864720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:58:34.864720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:58:34.864720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lH4oIml6txed07XrppfY0Z5jhCeqS9LCxxoulg2eAhfaJ8WphU-pzn12EaO7FXV8VEwOuzjKQEfCBldz9fUbgppMEKJd_VSbDb_aR-Ce__ScpKEICpMOfadH5ZH-EfODQJGUEz0cyaOMRlNct6asFRrMu0s30r91ZjclG___yh0IIw Aug 18 14:58:34.864720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:58:34.864720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:58:34.864720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:58:34.864720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:58:34.864720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:58:34.864720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:58:34.864720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:58:34.864720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:58:34.864720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:58:34.864720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:58:34.866281 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_55c9fe0cbbfa47bca81668c039afc092", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:58:34.866281 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:58:34.866281 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:58:34.866281 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:58:34.866281 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:58:34.866281 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:58:34.866281 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:58:34.866281 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 36dbc938bcd741f2a2b2013b6aa6f008 Aug 18 14:58:34.866281 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:58:34.866281 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:58:34.866281 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 3b930f52-a56c-4003-b85a-bf2905b6ba86 could not be found. Aug 18 14:58:34.866281 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '3b930f52-a56c-4003-b85a-bf2905b6ba86'} Aug 18 14:58:34.867254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:58:34.867254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:34.867254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:58:34.867254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:58:34.867254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:58:34.867254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:58:34.867254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:58:34.867254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:58:34.867254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:58:34.867254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:58:34.867254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b930f52-a56c-4003-b85a-bf2905b6ba86 could not be found. Aug 18 14:58:34.867254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:34.867254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:34.867254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:34.867254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:34.867254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:34.867254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:34.867254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:58:34.867254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:58:34.867254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:58:34.870156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:58:34.870156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:58:34.870156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:58:34.870156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:58:34.870156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:58:34.870156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:58:34.870156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:58:34.870156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b930f52-a56c-4003-b85a-bf2905b6ba86 could not be found. Aug 18 14:58:34.870156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:34.870156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:34.870156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:34.870156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:34.870156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:34.870156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:34.870156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:58:34.870156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:58:34.870156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b930f52-a56c-4003-b85a-bf2905b6ba86 could not be found. Aug 18 14:58:34.870156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:34.872128 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-37537d6b-4cb8-4ac3-9c13-85fc3c469835 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Returning 404 to user: Instance 3b930f52-a56c-4003-b85a-bf2905b6ba86 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:58:34.872128 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-37537d6b-4cb8-4ac3-9c13-85fc3c469835 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86" status: 404 len: 111 microversion: 2.1 time: 0.037496 Aug 18 14:58:34.872128 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 686/948] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:34 2022] GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 14:58:34.875113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-fa08fcc4-b721-4b8e-813a-12027d6b920b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '.version_select at 0x7fb2143d21f0>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:34.900549 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-fa08fcc4-b721-4b8e-813a-12027d6b920b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-722574651" status: 202 len: 0 microversion: 2.1 time: 0.028958 Aug 18 14:58:34.901141 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 687/949] 10.222.0.36 () {58 vars in 1218 bytes} [Thu Aug 18 14:58:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-722574651 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:58:35.218749 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-6d02f3eb-5115-469c-9373-7ab4af251088 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:35.219802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-6d02f3eb-5115-469c-9373-7ab4af251088 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:35.228431 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6d02f3eb-5115-469c-9373-7ab4af251088 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:35.229399 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6d02f3eb-5115-469c-9373-7ab4af251088 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:35.230519 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6d02f3eb-5115-469c-9373-7ab4af251088 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:35.230519 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6d02f3eb-5115-469c-9373-7ab4af251088 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:35.231358 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6d02f3eb-5115-469c-9373-7ab4af251088 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:35.231817 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6d02f3eb-5115-469c-9373-7ab4af251088 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:35.246765 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-6d02f3eb-5115-469c-9373-7ab4af251088 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] HTTP exception thrown: Instance 0587b3b6-bb0f-443b-8b28-0035ad738303 could not be found. Aug 18 14:58:35.248353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-6d02f3eb-5115-469c-9373-7ab4af251088 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Request method failure captured: Aug 18 14:58:35.248353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303 HTTP/1.1 Aug 18 14:58:35.248353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:58:35.248353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:58:35.248353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:58:35.248353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:58:35.248353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:58:35.248353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:58:35.248353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:58:35.248353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:58:35.248353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lH6BHXVVBz2bu2oI3N3lrYFUqap7g77I0qAQBxIqrO1qLF-L7AUzm1M2x4z2taZt045DURIw-nP_XJaZMwll8Au7wbfViaB3bev4Rw3_1RoqYXCk-UmoN76amBPnEJzgxY_Z3LPB7uMqWQN-lS61umlU4Vf17CSZL26XcnP1HzHBRU Aug 18 14:58:35.248353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:58:35.248353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:58:35.248353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:58:35.248353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:58:35.248353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:58:35.248353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:58:35.248353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: bde4e338430442449fcc203cd9493bc3 Aug 18 14:58:35.248353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-AttachVolumeTestJSON-1688587655 Aug 18 14:58:35.248353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:58:35.248353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:58:35.249954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bde4e338430442449fcc203cd9493bc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bde4e338430442449fcc203cd9493bc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bde4e338430442449fcc203cd9493bc3", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bde4e338430442449fcc203cd9493bc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:58:35.249954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-AttachVolumeTestJSON-1688587655 Aug 18 14:58:35.249954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: bde4e338430442449fcc203cd9493bc3 Aug 18 14:58:35.249954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1688587655 Aug 18 14:58:35.249954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-AttachVolumeTestJSON-1688587655-project Aug 18 14:58:35.249954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:58:35.249954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:58:35.249954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 4d96208474754b2381d769d807689bbb Aug 18 14:58:35.249954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-AttachVolumeTestJSON-1688587655-project Aug 18 14:58:35.249954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:58:35.249954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 0587b3b6-bb0f-443b-8b28-0035ad738303 could not be found. Aug 18 14:58:35.249954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '0587b3b6-bb0f-443b-8b28-0035ad738303'} Aug 18 14:58:35.251092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:58:35.251092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:35.251092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:58:35.251092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:58:35.251092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:58:35.251092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:58:35.251092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:58:35.251092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:58:35.251092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:58:35.251092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:58:35.251092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0587b3b6-bb0f-443b-8b28-0035ad738303 could not be found. Aug 18 14:58:35.251092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:35.251092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:35.251092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:35.251092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:35.251092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:35.251092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:35.251092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:58:35.251092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:58:35.251092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:58:35.252352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:58:35.252352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:58:35.252352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:58:35.252352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:58:35.252352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:58:35.252352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:58:35.252352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:58:35.252352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0587b3b6-bb0f-443b-8b28-0035ad738303 could not be found. Aug 18 14:58:35.252352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:35.252352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:35.252352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:35.252352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:35.252352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:35.252352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:35.252352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:58:35.252352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:58:35.252352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0587b3b6-bb0f-443b-8b28-0035ad738303 could not be found. Aug 18 14:58:35.252352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:35.253447 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-6d02f3eb-5115-469c-9373-7ab4af251088 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Returning 404 to user: Instance 0587b3b6-bb0f-443b-8b28-0035ad738303 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:58:35.253447 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-6d02f3eb-5115-469c-9373-7ab4af251088 tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303" status: 404 len: 111 microversion: 2.1 time: 0.036365 Aug 18 14:58:35.253447 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 688/950] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:35 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 14:58:35.264150 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5db97583-4ec6-4f49-b23a-3d1cd6e5b09e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '.version_select at 0x7fb2144340d0>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:35.285424 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-5db97583-4ec6-4f49-b23a-3d1cd6e5b09e tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1438896663" status: 202 len: 0 microversion: 2.1 time: 0.030108 Aug 18 14:58:35.290046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 689/951] 10.222.0.36 () {58 vars in 1221 bytes} [Thu Aug 18 14:58:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1438896663 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:58:35.541816 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-16446b85-3c00-4da1-9de3-e7a318ad91c8 req-81de138e-d5a3-4d05-96a3-44db8713501f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0587b3b6-bb0f-443b-8b28-0035ad738303", "name": "network-vif-deleted", "tag": "873d5f42-d16f-439c-afa0-71e8f2a27384"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:58:35.553431 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-16446b85-3c00-4da1-9de3-e7a318ad91c8 req-81de138e-d5a3-4d05-96a3-44db8713501f service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:35.554494 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-16446b85-3c00-4da1-9de3-e7a318ad91c8 req-81de138e-d5a3-4d05-96a3-44db8713501f service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:35.555080 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-16446b85-3c00-4da1-9de3-e7a318ad91c8 req-81de138e-d5a3-4d05-96a3-44db8713501f service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:35.569626 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-16446b85-3c00-4da1-9de3-e7a318ad91c8 req-81de138e-d5a3-4d05-96a3-44db8713501f service nova] Creating event network-vif-deleted:873d5f42-d16f-439c-afa0-71e8f2a27384 for instance 0587b3b6-bb0f-443b-8b28-0035ad738303 on hv-cinder-85220 Aug 18 14:58:35.586365 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-16446b85-3c00-4da1-9de3-e7a318ad91c8 req-81de138e-d5a3-4d05-96a3-44db8713501f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047894 Aug 18 14:58:35.587530 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 690/952] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:58:36.738458 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-06782200-29ed-4e97-9688-0419ae803f6c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:36.740338 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-06782200-29ed-4e97-9688-0419ae803f6c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:36.748605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-06782200-29ed-4e97-9688-0419ae803f6c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:36.749316 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-06782200-29ed-4e97-9688-0419ae803f6c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:36.749872 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-06782200-29ed-4e97-9688-0419ae803f6c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:36.750964 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-06782200-29ed-4e97-9688-0419ae803f6c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:36.751673 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-06782200-29ed-4e97-9688-0419ae803f6c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:36.752048 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-06782200-29ed-4e97-9688-0419ae803f6c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:36.767659 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-06782200-29ed-4e97-9688-0419ae803f6c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] HTTP exception thrown: Instance 3b930f52-a56c-4003-b85a-bf2905b6ba86 could not be found. Aug 18 14:58:36.769421 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-06782200-29ed-4e97-9688-0419ae803f6c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Request method failure captured: Aug 18 14:58:36.769421 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: DELETE /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86 HTTP/1.1 Aug 18 14:58:36.769421 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:58:36.769421 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:58:36.769421 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:58:36.769421 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:58:36.769421 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:58:36.769421 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:58:36.769421 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:58:36.769421 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:58:36.769421 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lH4oIml6txed07XrppfY0Z5jhCeqS9LCxxoulg2eAhfaJ8WphU-pzn12EaO7FXV8VEwOuzjKQEfCBldz9fUbgppMEKJd_VSbDb_aR-Ce__ScpKEICpMOfadH5ZH-EfODQJGUEz0cyaOMRlNct6asFRrMu0s30r91ZjclG___yh0IIw Aug 18 14:58:36.769421 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:58:36.769421 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:58:36.769421 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:58:36.769421 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:58:36.769421 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:58:36.769421 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:58:36.769421 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:58:36.769421 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:58:36.769421 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:58:36.769421 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:58:36.771586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_55c9fe0cbbfa47bca81668c039afc092", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:58:36.771586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:58:36.771586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:58:36.771586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:58:36.771586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:58:36.771586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:58:36.771586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:58:36.771586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 36dbc938bcd741f2a2b2013b6aa6f008 Aug 18 14:58:36.771586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:58:36.771586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:58:36.771586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 3b930f52-a56c-4003-b85a-bf2905b6ba86 could not be found. Aug 18 14:58:36.771586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '3b930f52-a56c-4003-b85a-bf2905b6ba86'} Aug 18 14:58:36.776215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:58:36.776215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:36.776215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:58:36.776215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:58:36.776215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:58:36.776215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:58:36.776215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:58:36.776215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:58:36.776215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:58:36.776215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:58:36.776215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b930f52-a56c-4003-b85a-bf2905b6ba86 could not be found. Aug 18 14:58:36.776215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:36.776215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:36.776215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:36.776215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:36.776215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:36.776215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:36.776215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:58:36.776215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:58:36.776215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:58:36.777654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:58:36.777654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 14:58:36.777654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 14:58:36.777654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 14:58:36.777654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 14:58:36.777654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:58:36.777654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:58:36.777654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:58:36.777654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:58:36.777654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b930f52-a56c-4003-b85a-bf2905b6ba86 could not be found. Aug 18 14:58:36.777654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:36.777654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:36.777654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:36.777654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:36.777654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:36.777654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:36.777654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:58:36.777654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:58:36.777654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b930f52-a56c-4003-b85a-bf2905b6ba86 could not be found. Aug 18 14:58:36.777654 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:36.779072 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-06782200-29ed-4e97-9688-0419ae803f6c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Returning 404 to user: Instance 3b930f52-a56c-4003-b85a-bf2905b6ba86 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:58:36.779072 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-06782200-29ed-4e97-9688-0419ae803f6c tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86" status: 404 len: 111 microversion: 2.1 time: 0.037866 Aug 18 14:58:36.779072 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 691/953] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 14:58:36 2022] DELETE /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 14:58:36.781058 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ae1b8975-3381-4348-841f-2b81455b9a04 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:36.781690 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ae1b8975-3381-4348-841f-2b81455b9a04 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 3b930f52-a56c-4003-b85a-bf2905b6ba86] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:36.788888 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ae1b8975-3381-4348-841f-2b81455b9a04 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:36.789383 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ae1b8975-3381-4348-841f-2b81455b9a04 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:36.789839 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ae1b8975-3381-4348-841f-2b81455b9a04 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:36.790748 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ae1b8975-3381-4348-841f-2b81455b9a04 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:36.791218 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ae1b8975-3381-4348-841f-2b81455b9a04 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:36.791648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ae1b8975-3381-4348-841f-2b81455b9a04 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:36.807540 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-ae1b8975-3381-4348-841f-2b81455b9a04 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] HTTP exception thrown: Instance 3b930f52-a56c-4003-b85a-bf2905b6ba86 could not be found. Aug 18 14:58:36.809261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ae1b8975-3381-4348-841f-2b81455b9a04 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Request method failure captured: Aug 18 14:58:36.809261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86 HTTP/1.1 Aug 18 14:58:36.809261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:58:36.809261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:58:36.809261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:58:36.809261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:58:36.809261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:58:36.809261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:58:36.809261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:58:36.809261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:58:36.809261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lH4oIml6txed07XrppfY0Z5jhCeqS9LCxxoulg2eAhfaJ8WphU-pzn12EaO7FXV8VEwOuzjKQEfCBldz9fUbgppMEKJd_VSbDb_aR-Ce__ScpKEICpMOfadH5ZH-EfODQJGUEz0cyaOMRlNct6asFRrMu0s30r91ZjclG___yh0IIw Aug 18 14:58:36.809261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:58:36.809261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:58:36.809261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:58:36.809261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:58:36.809261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:58:36.809261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:58:36.809261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:58:36.809261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:58:36.809261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:58:36.809261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:58:36.810815 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_55c9fe0cbbfa47bca81668c039afc092", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:58:36.810815 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:58:36.810815 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:58:36.810815 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:58:36.810815 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:58:36.810815 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:58:36.810815 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:58:36.810815 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 36dbc938bcd741f2a2b2013b6aa6f008 Aug 18 14:58:36.810815 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:58:36.810815 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:58:36.810815 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 3b930f52-a56c-4003-b85a-bf2905b6ba86 could not be found. Aug 18 14:58:36.810815 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '3b930f52-a56c-4003-b85a-bf2905b6ba86'} Aug 18 14:58:36.811764 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:58:36.811764 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:36.811764 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:58:36.811764 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:58:36.811764 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:58:36.811764 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:58:36.811764 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:58:36.811764 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:58:36.811764 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:58:36.811764 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:58:36.811764 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b930f52-a56c-4003-b85a-bf2905b6ba86 could not be found. Aug 18 14:58:36.811764 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:36.811764 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:36.811764 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:36.811764 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:36.811764 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:36.811764 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:36.811764 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:58:36.811764 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:58:36.811764 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:58:36.813226 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:58:36.813226 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:58:36.813226 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:58:36.813226 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:58:36.813226 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:58:36.813226 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:58:36.813226 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:58:36.813226 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b930f52-a56c-4003-b85a-bf2905b6ba86 could not be found. Aug 18 14:58:36.813226 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:36.813226 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:36.813226 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:36.813226 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:36.813226 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:36.813226 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:36.813226 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:58:36.813226 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:58:36.813226 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b930f52-a56c-4003-b85a-bf2905b6ba86 could not be found. Aug 18 14:58:36.813226 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:36.814537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ae1b8975-3381-4348-841f-2b81455b9a04 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Returning 404 to user: Instance 3b930f52-a56c-4003-b85a-bf2905b6ba86 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:58:36.815370 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-ae1b8975-3381-4348-841f-2b81455b9a04 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86" status: 404 len: 111 microversion: 2.1 time: 0.038572 Aug 18 14:58:36.816088 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 692/954] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:36 2022] GET /compute/v2.1/servers/3b930f52-a56c-4003-b85a-bf2905b6ba86 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 14:58:37.979075 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a7fc1444-0e5e-430e-8a0f-622913e4ea2b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:37.979747 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a7fc1444-0e5e-430e-8a0f-622913e4ea2b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:37.986304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a7fc1444-0e5e-430e-8a0f-622913e4ea2b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:37.986777 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a7fc1444-0e5e-430e-8a0f-622913e4ea2b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:37.987203 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a7fc1444-0e5e-430e-8a0f-622913e4ea2b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:37.987920 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a7fc1444-0e5e-430e-8a0f-622913e4ea2b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:37.988365 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a7fc1444-0e5e-430e-8a0f-622913e4ea2b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:37.988908 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a7fc1444-0e5e-430e-8a0f-622913e4ea2b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:38.002825 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-a7fc1444-0e5e-430e-8a0f-622913e4ea2b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] HTTP exception thrown: Instance 0423b68b-575f-459e-a227-32d920e325cf could not be found. Aug 18 14:58:38.005087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a7fc1444-0e5e-430e-8a0f-622913e4ea2b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Request method failure captured: Aug 18 14:58:38.005087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: DELETE /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf HTTP/1.1 Aug 18 14:58:38.005087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:58:38.005087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:58:38.005087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:58:38.005087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:58:38.005087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:58:38.005087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:58:38.005087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:58:38.005087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:58:38.005087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lH4oIml6txed07XrppfY0Z5jhCeqS9LCxxoulg2eAhfaJ8WphU-pzn12EaO7FXV8VEwOuzjKQEfCBldz9fUbgppMEKJd_VSbDb_aR-Ce__ScpKEICpMOfadH5ZH-EfODQJGUEz0cyaOMRlNct6asFRrMu0s30r91ZjclG___yh0IIw Aug 18 14:58:38.005087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:58:38.005087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:58:38.005087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:58:38.005087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:58:38.005087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:58:38.005087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:58:38.005087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:58:38.005087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:58:38.005087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:58:38.005087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:58:38.006700 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_55c9fe0cbbfa47bca81668c039afc092", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:58:38.006700 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:58:38.006700 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:58:38.006700 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:58:38.006700 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:58:38.006700 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:58:38.006700 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:58:38.006700 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 36dbc938bcd741f2a2b2013b6aa6f008 Aug 18 14:58:38.006700 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:58:38.006700 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:58:38.006700 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 0423b68b-575f-459e-a227-32d920e325cf could not be found. Aug 18 14:58:38.006700 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '0423b68b-575f-459e-a227-32d920e325cf'} Aug 18 14:58:38.007503 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:58:38.007503 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:38.007503 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:58:38.007503 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:58:38.007503 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:58:38.007503 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:58:38.007503 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:58:38.007503 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:58:38.007503 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:58:38.007503 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:58:38.007503 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0423b68b-575f-459e-a227-32d920e325cf could not be found. Aug 18 14:58:38.007503 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.007503 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:38.007503 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.007503 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:38.007503 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:38.007503 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:38.007503 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:58:38.007503 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:58:38.007503 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:58:38.008822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:58:38.008822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 14:58:38.008822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 14:58:38.008822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 14:58:38.008822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 14:58:38.008822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:58:38.008822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:58:38.008822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:58:38.008822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:58:38.008822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0423b68b-575f-459e-a227-32d920e325cf could not be found. Aug 18 14:58:38.008822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.008822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:38.008822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.008822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:38.008822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:38.008822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:38.008822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:58:38.008822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:58:38.008822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0423b68b-575f-459e-a227-32d920e325cf could not be found. Aug 18 14:58:38.008822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.010060 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a7fc1444-0e5e-430e-8a0f-622913e4ea2b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Returning 404 to user: Instance 0423b68b-575f-459e-a227-32d920e325cf could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:58:38.010060 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a7fc1444-0e5e-430e-8a0f-622913e4ea2b tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf" status: 404 len: 111 microversion: 2.1 time: 0.031332 Aug 18 14:58:38.010060 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 693/955] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 14:58:37 2022] DELETE /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 14:58:38.015154 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2bce9684-cfcd-4d03-ab05-7a9be7501350 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:38.015792 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2bce9684-cfcd-4d03-ab05-7a9be7501350 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 0423b68b-575f-459e-a227-32d920e325cf] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:38.022238 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2bce9684-cfcd-4d03-ab05-7a9be7501350 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:38.022725 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2bce9684-cfcd-4d03-ab05-7a9be7501350 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:38.023165 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2bce9684-cfcd-4d03-ab05-7a9be7501350 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:38.023888 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2bce9684-cfcd-4d03-ab05-7a9be7501350 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:38.024345 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2bce9684-cfcd-4d03-ab05-7a9be7501350 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:38.024771 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2bce9684-cfcd-4d03-ab05-7a9be7501350 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:38.038689 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-2bce9684-cfcd-4d03-ab05-7a9be7501350 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] HTTP exception thrown: Instance 0423b68b-575f-459e-a227-32d920e325cf could not be found. Aug 18 14:58:38.040384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2bce9684-cfcd-4d03-ab05-7a9be7501350 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Request method failure captured: Aug 18 14:58:38.040384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf HTTP/1.1 Aug 18 14:58:38.040384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:58:38.040384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:58:38.040384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:58:38.040384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:58:38.040384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:58:38.040384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:58:38.040384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:58:38.040384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:58:38.040384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lH4oIml6txed07XrppfY0Z5jhCeqS9LCxxoulg2eAhfaJ8WphU-pzn12EaO7FXV8VEwOuzjKQEfCBldz9fUbgppMEKJd_VSbDb_aR-Ce__ScpKEICpMOfadH5ZH-EfODQJGUEz0cyaOMRlNct6asFRrMu0s30r91ZjclG___yh0IIw Aug 18 14:58:38.040384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:58:38.040384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:58:38.040384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:58:38.040384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:58:38.040384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:58:38.040384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:58:38.040384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:58:38.040384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:58:38.040384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:58:38.040384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:58:38.041957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_55c9fe0cbbfa47bca81668c039afc092", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:58:38.041957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:58:38.041957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:58:38.041957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:58:38.041957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:58:38.041957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:58:38.041957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:58:38.041957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 36dbc938bcd741f2a2b2013b6aa6f008 Aug 18 14:58:38.041957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:58:38.041957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:58:38.041957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 0423b68b-575f-459e-a227-32d920e325cf could not be found. Aug 18 14:58:38.041957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '0423b68b-575f-459e-a227-32d920e325cf'} Aug 18 14:58:38.042760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:58:38.042760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:38.042760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:58:38.042760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:58:38.042760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:58:38.042760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:58:38.042760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:58:38.042760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:58:38.042760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:58:38.042760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:58:38.042760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0423b68b-575f-459e-a227-32d920e325cf could not be found. Aug 18 14:58:38.042760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.042760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:38.042760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.042760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:38.042760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:38.042760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:38.042760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:58:38.042760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:58:38.042760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:58:38.044007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:58:38.044007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:58:38.044007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:58:38.044007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:58:38.044007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:58:38.044007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:58:38.044007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:58:38.044007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0423b68b-575f-459e-a227-32d920e325cf could not be found. Aug 18 14:58:38.044007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.044007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:38.044007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.044007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:38.044007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:38.044007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:38.044007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:58:38.044007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:58:38.044007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0423b68b-575f-459e-a227-32d920e325cf could not be found. Aug 18 14:58:38.044007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.045259 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2bce9684-cfcd-4d03-ab05-7a9be7501350 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Returning 404 to user: Instance 0423b68b-575f-459e-a227-32d920e325cf could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:58:38.045259 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2bce9684-cfcd-4d03-ab05-7a9be7501350 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf" status: 404 len: 111 microversion: 2.1 time: 0.030509 Aug 18 14:58:38.045259 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 694/956] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:38 2022] GET /compute/v2.1/servers/0423b68b-575f-459e-a227-32d920e325cf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:58:38.049845 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-cd4fabad-a7f5-473f-bf5c-b4e8fc6db5e4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:38.050318 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-cd4fabad-a7f5-473f-bf5c-b4e8fc6db5e4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:38.056478 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cd4fabad-a7f5-473f-bf5c-b4e8fc6db5e4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:38.056961 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cd4fabad-a7f5-473f-bf5c-b4e8fc6db5e4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:38.057393 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cd4fabad-a7f5-473f-bf5c-b4e8fc6db5e4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:38.058113 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cd4fabad-a7f5-473f-bf5c-b4e8fc6db5e4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:38.058567 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cd4fabad-a7f5-473f-bf5c-b4e8fc6db5e4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:38.058994 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cd4fabad-a7f5-473f-bf5c-b4e8fc6db5e4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:38.073141 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-cd4fabad-a7f5-473f-bf5c-b4e8fc6db5e4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] HTTP exception thrown: Instance aa15c998-af91-4654-9cf6-ee7b4b1da164 could not be found. Aug 18 14:58:38.074688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-cd4fabad-a7f5-473f-bf5c-b4e8fc6db5e4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Request method failure captured: Aug 18 14:58:38.074688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: DELETE /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 HTTP/1.1 Aug 18 14:58:38.074688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:58:38.074688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:58:38.074688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:58:38.074688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:58:38.074688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:58:38.074688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:58:38.074688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:58:38.074688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:58:38.074688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lH4oIml6txed07XrppfY0Z5jhCeqS9LCxxoulg2eAhfaJ8WphU-pzn12EaO7FXV8VEwOuzjKQEfCBldz9fUbgppMEKJd_VSbDb_aR-Ce__ScpKEICpMOfadH5ZH-EfODQJGUEz0cyaOMRlNct6asFRrMu0s30r91ZjclG___yh0IIw Aug 18 14:58:38.074688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:58:38.074688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:58:38.074688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:58:38.074688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:58:38.074688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:58:38.074688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:58:38.074688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:58:38.074688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:58:38.074688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:58:38.074688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:58:38.076240 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_55c9fe0cbbfa47bca81668c039afc092", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:58:38.076240 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:58:38.076240 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:58:38.076240 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:58:38.076240 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:58:38.076240 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:58:38.076240 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:58:38.076240 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 36dbc938bcd741f2a2b2013b6aa6f008 Aug 18 14:58:38.076240 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:58:38.076240 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:58:38.076240 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance aa15c998-af91-4654-9cf6-ee7b4b1da164 could not be found. Aug 18 14:58:38.076240 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': 'aa15c998-af91-4654-9cf6-ee7b4b1da164'} Aug 18 14:58:38.077050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:58:38.077050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:38.077050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:58:38.077050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:58:38.077050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:58:38.077050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:58:38.077050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:58:38.077050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:58:38.077050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:58:38.077050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:58:38.077050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa15c998-af91-4654-9cf6-ee7b4b1da164 could not be found. Aug 18 14:58:38.077050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.077050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:38.077050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.077050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:38.077050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:38.077050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:38.077050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:58:38.077050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:58:38.077050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:58:38.078304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:58:38.078304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 14:58:38.078304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 14:58:38.078304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 14:58:38.078304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 14:58:38.078304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:58:38.078304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:58:38.078304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:58:38.078304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:58:38.078304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa15c998-af91-4654-9cf6-ee7b4b1da164 could not be found. Aug 18 14:58:38.078304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.078304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:38.078304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.078304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:38.078304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:38.078304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:38.078304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:58:38.078304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:58:38.078304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa15c998-af91-4654-9cf6-ee7b4b1da164 could not be found. Aug 18 14:58:38.078304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.079483 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-cd4fabad-a7f5-473f-bf5c-b4e8fc6db5e4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Returning 404 to user: Instance aa15c998-af91-4654-9cf6-ee7b4b1da164 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:58:38.079483 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-cd4fabad-a7f5-473f-bf5c-b4e8fc6db5e4 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "DELETE /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 404 len: 111 microversion: 2.1 time: 0.029874 Aug 18 14:58:38.079483 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 695/957] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 14:58:38 2022] DELETE /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:58:38.085982 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c688a9a5-1be5-497a-8838-cd05734d8758 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:38.086672 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c688a9a5-1be5-497a-8838-cd05734d8758 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: aa15c998-af91-4654-9cf6-ee7b4b1da164] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:38.092605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c688a9a5-1be5-497a-8838-cd05734d8758 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:38.093085 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c688a9a5-1be5-497a-8838-cd05734d8758 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:38.093519 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c688a9a5-1be5-497a-8838-cd05734d8758 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:38.094206 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c688a9a5-1be5-497a-8838-cd05734d8758 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:38.094658 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c688a9a5-1be5-497a-8838-cd05734d8758 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:38.095081 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c688a9a5-1be5-497a-8838-cd05734d8758 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:38.108556 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-c688a9a5-1be5-497a-8838-cd05734d8758 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] HTTP exception thrown: Instance aa15c998-af91-4654-9cf6-ee7b4b1da164 could not be found. Aug 18 14:58:38.110096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c688a9a5-1be5-497a-8838-cd05734d8758 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Request method failure captured: Aug 18 14:58:38.110096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 HTTP/1.1 Aug 18 14:58:38.110096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:58:38.110096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:58:38.110096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:58:38.110096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:58:38.110096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:58:38.110096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:58:38.110096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:58:38.110096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:58:38.110096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lH4oIml6txed07XrppfY0Z5jhCeqS9LCxxoulg2eAhfaJ8WphU-pzn12EaO7FXV8VEwOuzjKQEfCBldz9fUbgppMEKJd_VSbDb_aR-Ce__ScpKEICpMOfadH5ZH-EfODQJGUEz0cyaOMRlNct6asFRrMu0s30r91ZjclG___yh0IIw Aug 18 14:58:38.110096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:58:38.110096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:58:38.110096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:58:38.110096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:58:38.110096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:58:38.110096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:58:38.110096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:58:38.110096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:58:38.110096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:58:38.110096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:58:38.111802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_55c9fe0cbbfa47bca81668c039afc092", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:58:38.111802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:58:38.111802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:58:38.111802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:58:38.111802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:58:38.111802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:58:38.111802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:58:38.111802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 36dbc938bcd741f2a2b2013b6aa6f008 Aug 18 14:58:38.111802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:58:38.111802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:58:38.111802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance aa15c998-af91-4654-9cf6-ee7b4b1da164 could not be found. Aug 18 14:58:38.111802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': 'aa15c998-af91-4654-9cf6-ee7b4b1da164'} Aug 18 14:58:38.112596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:58:38.112596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:38.112596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:58:38.112596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:58:38.112596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:58:38.112596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:58:38.112596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:58:38.112596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:58:38.112596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:58:38.112596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:58:38.112596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa15c998-af91-4654-9cf6-ee7b4b1da164 could not be found. Aug 18 14:58:38.112596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.112596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:38.112596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.112596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:38.112596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:38.112596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:38.112596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:58:38.112596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:58:38.112596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:58:38.113894 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:58:38.113894 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:58:38.113894 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:58:38.113894 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:58:38.113894 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:58:38.113894 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:58:38.113894 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:58:38.113894 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa15c998-af91-4654-9cf6-ee7b4b1da164 could not be found. Aug 18 14:58:38.113894 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.113894 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:38.113894 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.113894 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:38.113894 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:38.113894 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:38.113894 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:58:38.113894 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:58:38.113894 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa15c998-af91-4654-9cf6-ee7b4b1da164 could not be found. Aug 18 14:58:38.113894 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.114957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c688a9a5-1be5-497a-8838-cd05734d8758 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Returning 404 to user: Instance aa15c998-af91-4654-9cf6-ee7b4b1da164 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:58:38.114957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c688a9a5-1be5-497a-8838-cd05734d8758 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164" status: 404 len: 111 microversion: 2.1 time: 0.029643 Aug 18 14:58:38.114957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 696/958] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:38 2022] GET /compute/v2.1/servers/aa15c998-af91-4654-9cf6-ee7b4b1da164 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 14:58:38.514828 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e162e6b0-53de-4902-85b0-43823fd43c1c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:38.515324 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e162e6b0-53de-4902-85b0-43823fd43c1c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:38.522700 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e162e6b0-53de-4902-85b0-43823fd43c1c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:38.523176 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e162e6b0-53de-4902-85b0-43823fd43c1c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:38.523603 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e162e6b0-53de-4902-85b0-43823fd43c1c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:38.524490 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e162e6b0-53de-4902-85b0-43823fd43c1c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:38.524938 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e162e6b0-53de-4902-85b0-43823fd43c1c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:38.525358 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e162e6b0-53de-4902-85b0-43823fd43c1c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:38.541125 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-e162e6b0-53de-4902-85b0-43823fd43c1c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] HTTP exception thrown: Instance 0587b3b6-bb0f-443b-8b28-0035ad738303 could not be found. Aug 18 14:58:38.542699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e162e6b0-53de-4902-85b0-43823fd43c1c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Request method failure captured: Aug 18 14:58:38.542699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: DELETE /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303 HTTP/1.1 Aug 18 14:58:38.542699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:58:38.542699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:58:38.542699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:58:38.542699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:58:38.542699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:58:38.542699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:58:38.542699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:58:38.542699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:58:38.542699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lH6BHXVVBz2bu2oI3N3lrYFUqap7g77I0qAQBxIqrO1qLF-L7AUzm1M2x4z2taZt045DURIw-nP_XJaZMwll8Au7wbfViaB3bev4Rw3_1RoqYXCk-UmoN76amBPnEJzgxY_Z3LPB7uMqWQN-lS61umlU4Vf17CSZL26XcnP1HzHBRU Aug 18 14:58:38.542699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:58:38.542699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:58:38.542699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:58:38.542699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:58:38.542699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:58:38.542699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:58:38.542699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: bde4e338430442449fcc203cd9493bc3 Aug 18 14:58:38.542699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-AttachVolumeTestJSON-1688587655 Aug 18 14:58:38.542699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:58:38.542699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:58:38.544527 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bde4e338430442449fcc203cd9493bc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bde4e338430442449fcc203cd9493bc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bde4e338430442449fcc203cd9493bc3", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bde4e338430442449fcc203cd9493bc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:58:38.544527 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-AttachVolumeTestJSON-1688587655 Aug 18 14:58:38.544527 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: bde4e338430442449fcc203cd9493bc3 Aug 18 14:58:38.544527 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1688587655 Aug 18 14:58:38.544527 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-AttachVolumeTestJSON-1688587655-project Aug 18 14:58:38.544527 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:58:38.544527 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:58:38.544527 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 4d96208474754b2381d769d807689bbb Aug 18 14:58:38.544527 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-AttachVolumeTestJSON-1688587655-project Aug 18 14:58:38.544527 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:58:38.544527 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 0587b3b6-bb0f-443b-8b28-0035ad738303 could not be found. Aug 18 14:58:38.544527 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '0587b3b6-bb0f-443b-8b28-0035ad738303'} Aug 18 14:58:38.545571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:58:38.545571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:38.545571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:58:38.545571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:58:38.545571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:58:38.545571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:58:38.545571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:58:38.545571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:58:38.545571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:58:38.545571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:58:38.545571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0587b3b6-bb0f-443b-8b28-0035ad738303 could not be found. Aug 18 14:58:38.545571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.545571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:38.545571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.545571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:38.545571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:38.545571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:38.545571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:58:38.545571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:58:38.545571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:58:38.547022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:58:38.547022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 14:58:38.547022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 14:58:38.547022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 14:58:38.547022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 14:58:38.547022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:58:38.547022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:58:38.547022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:58:38.547022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:58:38.547022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0587b3b6-bb0f-443b-8b28-0035ad738303 could not be found. Aug 18 14:58:38.547022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.547022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:38.547022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.547022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:38.547022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:38.547022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:38.547022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:58:38.547022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:58:38.547022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0587b3b6-bb0f-443b-8b28-0035ad738303 could not be found. Aug 18 14:58:38.547022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.548575 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e162e6b0-53de-4902-85b0-43823fd43c1c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Returning 404 to user: Instance 0587b3b6-bb0f-443b-8b28-0035ad738303 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:58:38.548575 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e162e6b0-53de-4902-85b0-43823fd43c1c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303" status: 404 len: 111 microversion: 2.1 time: 0.034096 Aug 18 14:58:38.548575 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 697/959] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 14:58:38 2022] DELETE /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 14:58:38.552106 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-50918d01-2a0d-436e-a33b-2f46868d6f5f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:38.552743 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-50918d01-2a0d-436e-a33b-2f46868d6f5f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: 0587b3b6-bb0f-443b-8b28-0035ad738303] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:38.558652 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-50918d01-2a0d-436e-a33b-2f46868d6f5f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:38.559131 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-50918d01-2a0d-436e-a33b-2f46868d6f5f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:38.559560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-50918d01-2a0d-436e-a33b-2f46868d6f5f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:38.560290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-50918d01-2a0d-436e-a33b-2f46868d6f5f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:38.560742 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-50918d01-2a0d-436e-a33b-2f46868d6f5f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:38.561164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-50918d01-2a0d-436e-a33b-2f46868d6f5f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:38.574330 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-50918d01-2a0d-436e-a33b-2f46868d6f5f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] HTTP exception thrown: Instance 0587b3b6-bb0f-443b-8b28-0035ad738303 could not be found. Aug 18 14:58:38.575882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-50918d01-2a0d-436e-a33b-2f46868d6f5f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Request method failure captured: Aug 18 14:58:38.575882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303 HTTP/1.1 Aug 18 14:58:38.575882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:58:38.575882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:58:38.575882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:58:38.575882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:58:38.575882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:58:38.575882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:58:38.575882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:58:38.575882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:58:38.575882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lH6BHXVVBz2bu2oI3N3lrYFUqap7g77I0qAQBxIqrO1qLF-L7AUzm1M2x4z2taZt045DURIw-nP_XJaZMwll8Au7wbfViaB3bev4Rw3_1RoqYXCk-UmoN76amBPnEJzgxY_Z3LPB7uMqWQN-lS61umlU4Vf17CSZL26XcnP1HzHBRU Aug 18 14:58:38.575882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:58:38.575882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:58:38.575882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:58:38.575882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:58:38.575882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:58:38.575882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:58:38.575882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: bde4e338430442449fcc203cd9493bc3 Aug 18 14:58:38.575882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-AttachVolumeTestJSON-1688587655 Aug 18 14:58:38.575882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:58:38.575882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:58:38.577522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bde4e338430442449fcc203cd9493bc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bde4e338430442449fcc203cd9493bc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bde4e338430442449fcc203cd9493bc3", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bde4e338430442449fcc203cd9493bc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:58:38.577522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-AttachVolumeTestJSON-1688587655 Aug 18 14:58:38.577522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: bde4e338430442449fcc203cd9493bc3 Aug 18 14:58:38.577522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1688587655 Aug 18 14:58:38.577522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-AttachVolumeTestJSON-1688587655-project Aug 18 14:58:38.577522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:58:38.577522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:58:38.577522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 4d96208474754b2381d769d807689bbb Aug 18 14:58:38.577522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-AttachVolumeTestJSON-1688587655-project Aug 18 14:58:38.577522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:58:38.577522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 0587b3b6-bb0f-443b-8b28-0035ad738303 could not be found. Aug 18 14:58:38.577522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '0587b3b6-bb0f-443b-8b28-0035ad738303'} Aug 18 14:58:38.578537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:58:38.578537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:38.578537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:58:38.578537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:58:38.578537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:58:38.578537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:58:38.578537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:58:38.578537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:58:38.578537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:58:38.578537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:58:38.578537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0587b3b6-bb0f-443b-8b28-0035ad738303 could not be found. Aug 18 14:58:38.578537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.578537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:38.578537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.578537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:38.578537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:38.578537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:38.578537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:58:38.578537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:58:38.578537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:58:38.580003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:58:38.580003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:58:38.580003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:58:38.580003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:58:38.580003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:58:38.580003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:58:38.580003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:58:38.580003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0587b3b6-bb0f-443b-8b28-0035ad738303 could not be found. Aug 18 14:58:38.580003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.580003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:38.580003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.580003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:38.580003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:38.580003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:38.580003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:58:38.580003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:58:38.580003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0587b3b6-bb0f-443b-8b28-0035ad738303 could not be found. Aug 18 14:58:38.580003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:38.581410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-50918d01-2a0d-436e-a33b-2f46868d6f5f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Returning 404 to user: Instance 0587b3b6-bb0f-443b-8b28-0035ad738303 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:58:38.581410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-50918d01-2a0d-436e-a33b-2f46868d6f5f tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303" status: 404 len: 111 microversion: 2.1 time: 0.028638 Aug 18 14:58:38.581410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 698/960] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:38 2022] GET /compute/v2.1/servers/0587b3b6-bb0f-443b-8b28-0035ad738303 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 14:58:39.266041 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-6877bb9c-e82c-42c7-88f6-4e66db6c63ec tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:39.266625 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-6877bb9c-e82c-42c7-88f6-4e66db6c63ec tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:39.273493 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6877bb9c-e82c-42c7-88f6-4e66db6c63ec tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:39.273963 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6877bb9c-e82c-42c7-88f6-4e66db6c63ec tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:39.274393 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6877bb9c-e82c-42c7-88f6-4e66db6c63ec tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:39.275075 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6877bb9c-e82c-42c7-88f6-4e66db6c63ec tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:39.275523 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6877bb9c-e82c-42c7-88f6-4e66db6c63ec tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:39.275965 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6877bb9c-e82c-42c7-88f6-4e66db6c63ec tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:39.289726 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-6877bb9c-e82c-42c7-88f6-4e66db6c63ec tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] HTTP exception thrown: Instance 89777120-9e0a-40d0-b71d-b73882a1a5e6 could not be found. Aug 18 14:58:39.291264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-6877bb9c-e82c-42c7-88f6-4e66db6c63ec tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Request method failure captured: Aug 18 14:58:39.291264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: DELETE /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 HTTP/1.1 Aug 18 14:58:39.291264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:58:39.291264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:58:39.291264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:58:39.291264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:58:39.291264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:58:39.291264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:58:39.291264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:58:39.291264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:58:39.291264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lH4oIml6txed07XrppfY0Z5jhCeqS9LCxxoulg2eAhfaJ8WphU-pzn12EaO7FXV8VEwOuzjKQEfCBldz9fUbgppMEKJd_VSbDb_aR-Ce__ScpKEICpMOfadH5ZH-EfODQJGUEz0cyaOMRlNct6asFRrMu0s30r91ZjclG___yh0IIw Aug 18 14:58:39.291264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:58:39.291264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:58:39.291264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:58:39.291264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:58:39.291264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:58:39.291264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:58:39.291264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:58:39.291264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:58:39.291264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:58:39.291264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:58:39.292864 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_55c9fe0cbbfa47bca81668c039afc092", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:58:39.292864 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:58:39.292864 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:58:39.292864 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:58:39.292864 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:58:39.292864 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:58:39.292864 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:58:39.292864 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 36dbc938bcd741f2a2b2013b6aa6f008 Aug 18 14:58:39.292864 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:58:39.292864 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:58:39.292864 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 89777120-9e0a-40d0-b71d-b73882a1a5e6 could not be found. Aug 18 14:58:39.292864 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '89777120-9e0a-40d0-b71d-b73882a1a5e6'} Aug 18 14:58:39.293762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:58:39.293762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:39.293762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:58:39.293762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:58:39.293762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:58:39.293762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:58:39.293762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:58:39.293762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:58:39.293762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:58:39.293762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:58:39.293762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89777120-9e0a-40d0-b71d-b73882a1a5e6 could not be found. Aug 18 14:58:39.293762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:39.293762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:39.293762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:39.293762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:39.293762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:39.293762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:39.293762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:58:39.293762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:58:39.293762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:58:39.295193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:58:39.295193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 14:58:39.295193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 14:58:39.295193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 14:58:39.295193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 14:58:39.295193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:58:39.295193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:58:39.295193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:58:39.295193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:58:39.295193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89777120-9e0a-40d0-b71d-b73882a1a5e6 could not be found. Aug 18 14:58:39.295193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:39.295193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:39.295193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:39.295193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:39.295193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:39.295193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:39.295193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:58:39.295193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:58:39.295193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89777120-9e0a-40d0-b71d-b73882a1a5e6 could not be found. Aug 18 14:58:39.295193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:39.296626 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-6877bb9c-e82c-42c7-88f6-4e66db6c63ec tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Returning 404 to user: Instance 89777120-9e0a-40d0-b71d-b73882a1a5e6 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:58:39.296626 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-6877bb9c-e82c-42c7-88f6-4e66db6c63ec tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "DELETE /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 404 len: 111 microversion: 2.1 time: 0.031170 Aug 18 14:58:39.296626 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 699/961] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 14:58:39 2022] DELETE /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:58:39.300754 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a76ad199-0dd1-4b62-9ff7-1f06e1875e94 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:39.301372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a76ad199-0dd1-4b62-9ff7-1f06e1875e94 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] [instance: 89777120-9e0a-40d0-b71d-b73882a1a5e6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:39.307057 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a76ad199-0dd1-4b62-9ff7-1f06e1875e94 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:39.307535 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a76ad199-0dd1-4b62-9ff7-1f06e1875e94 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:39.308117 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a76ad199-0dd1-4b62-9ff7-1f06e1875e94 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:39.308803 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a76ad199-0dd1-4b62-9ff7-1f06e1875e94 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:39.309273 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a76ad199-0dd1-4b62-9ff7-1f06e1875e94 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:39.309688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a76ad199-0dd1-4b62-9ff7-1f06e1875e94 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:39.322929 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-a76ad199-0dd1-4b62-9ff7-1f06e1875e94 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] HTTP exception thrown: Instance 89777120-9e0a-40d0-b71d-b73882a1a5e6 could not be found. Aug 18 14:58:39.324485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a76ad199-0dd1-4b62-9ff7-1f06e1875e94 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Request method failure captured: Aug 18 14:58:39.324485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 HTTP/1.1 Aug 18 14:58:39.324485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:58:39.324485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:58:39.324485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:58:39.324485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:58:39.324485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:58:39.324485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:58:39.324485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:58:39.324485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:58:39.324485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lH4oIml6txed07XrppfY0Z5jhCeqS9LCxxoulg2eAhfaJ8WphU-pzn12EaO7FXV8VEwOuzjKQEfCBldz9fUbgppMEKJd_VSbDb_aR-Ce__ScpKEICpMOfadH5ZH-EfODQJGUEz0cyaOMRlNct6asFRrMu0s30r91ZjclG___yh0IIw Aug 18 14:58:39.324485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:58:39.324485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:58:39.324485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:58:39.324485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:58:39.324485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:58:39.324485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:58:39.324485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:58:39.324485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:58:39.324485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:58:39.324485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:58:39.326007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_55c9fe0cbbfa47bca81668c039afc092", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/55c9fe0cbbfa47bca81668c039afc092"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:58:39.326007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:58:39.326007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: 55c9fe0cbbfa47bca81668c039afc092 Aug 18 14:58:39.326007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426556178 Aug 18 14:58:39.326007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:58:39.326007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:58:39.326007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:58:39.326007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 36dbc938bcd741f2a2b2013b6aa6f008 Aug 18 14:58:39.326007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-AttachVolumeNegativeTest-426556178-project Aug 18 14:58:39.326007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:58:39.326007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 89777120-9e0a-40d0-b71d-b73882a1a5e6 could not be found. Aug 18 14:58:39.326007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '89777120-9e0a-40d0-b71d-b73882a1a5e6'} Aug 18 14:58:39.326896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:58:39.326896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:39.326896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:58:39.326896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:58:39.326896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:58:39.326896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:58:39.326896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:58:39.326896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:58:39.326896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:58:39.326896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:58:39.326896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89777120-9e0a-40d0-b71d-b73882a1a5e6 could not be found. Aug 18 14:58:39.326896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:39.326896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:39.326896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:39.326896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:39.326896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:39.326896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:39.326896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:58:39.326896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:58:39.326896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:58:39.328382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:58:39.328382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:58:39.328382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:58:39.328382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:58:39.328382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:58:39.328382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:58:39.328382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:58:39.328382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89777120-9e0a-40d0-b71d-b73882a1a5e6 could not be found. Aug 18 14:58:39.328382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:39.328382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:39.328382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:39.328382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:39.328382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:39.328382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:39.328382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:58:39.328382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:58:39.328382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89777120-9e0a-40d0-b71d-b73882a1a5e6 could not be found. Aug 18 14:58:39.328382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:39.329665 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a76ad199-0dd1-4b62-9ff7-1f06e1875e94 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] Returning 404 to user: Instance 89777120-9e0a-40d0-b71d-b73882a1a5e6 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:58:39.329665 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a76ad199-0dd1-4b62-9ff7-1f06e1875e94 tempest-AttachVolumeNegativeTest-426556178 tempest-AttachVolumeNegativeTest-426556178-project] 10.222.0.36 "GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6" status: 404 len: 111 microversion: 2.1 time: 0.028676 Aug 18 14:58:39.329665 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 700/962] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:39 2022] GET /compute/v2.1/servers/89777120-9e0a-40d0-b71d-b73882a1a5e6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 14:58:39.722746 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-893491a7-fc66-4fab-9e75-055b492d1c8a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:39.723773 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-893491a7-fc66-4fab-9e75-055b492d1c8a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:39.730058 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-893491a7-fc66-4fab-9e75-055b492d1c8a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:39.730546 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-893491a7-fc66-4fab-9e75-055b492d1c8a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:39.730982 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-893491a7-fc66-4fab-9e75-055b492d1c8a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:39.731697 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-893491a7-fc66-4fab-9e75-055b492d1c8a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:39.732155 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-893491a7-fc66-4fab-9e75-055b492d1c8a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:39.732582 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-893491a7-fc66-4fab-9e75-055b492d1c8a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:39.747271 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-893491a7-fc66-4fab-9e75-055b492d1c8a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] HTTP exception thrown: Instance c9d85d35-e080-4901-a147-87b0aaf6c5e5 could not be found. Aug 18 14:58:39.749134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-893491a7-fc66-4fab-9e75-055b492d1c8a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Request method failure captured: Aug 18 14:58:39.749134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: DELETE /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 HTTP/1.1 Aug 18 14:58:39.749134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:58:39.749134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:58:39.749134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:58:39.749134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:58:39.749134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:58:39.749134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:58:39.749134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:58:39.749134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:58:39.749134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lH6BHXVVBz2bu2oI3N3lrYFUqap7g77I0qAQBxIqrO1qLF-L7AUzm1M2x4z2taZt045DURIw-nP_XJaZMwll8Au7wbfViaB3bev4Rw3_1RoqYXCk-UmoN76amBPnEJzgxY_Z3LPB7uMqWQN-lS61umlU4Vf17CSZL26XcnP1HzHBRU Aug 18 14:58:39.749134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:58:39.749134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:58:39.749134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:58:39.749134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:58:39.749134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:58:39.749134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:58:39.749134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: bde4e338430442449fcc203cd9493bc3 Aug 18 14:58:39.749134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-AttachVolumeTestJSON-1688587655 Aug 18 14:58:39.749134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:58:39.749134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:58:39.750750 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bde4e338430442449fcc203cd9493bc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bde4e338430442449fcc203cd9493bc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bde4e338430442449fcc203cd9493bc3", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bde4e338430442449fcc203cd9493bc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:58:39.750750 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-AttachVolumeTestJSON-1688587655 Aug 18 14:58:39.750750 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: bde4e338430442449fcc203cd9493bc3 Aug 18 14:58:39.750750 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1688587655 Aug 18 14:58:39.750750 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-AttachVolumeTestJSON-1688587655-project Aug 18 14:58:39.750750 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:58:39.750750 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:58:39.750750 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 4d96208474754b2381d769d807689bbb Aug 18 14:58:39.750750 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-AttachVolumeTestJSON-1688587655-project Aug 18 14:58:39.750750 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:58:39.750750 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance c9d85d35-e080-4901-a147-87b0aaf6c5e5 could not be found. Aug 18 14:58:39.750750 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': 'c9d85d35-e080-4901-a147-87b0aaf6c5e5'} Aug 18 14:58:39.751559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:58:39.751559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:39.751559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:58:39.751559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:58:39.751559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:58:39.751559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:58:39.751559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:58:39.751559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:58:39.751559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:58:39.751559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:58:39.751559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9d85d35-e080-4901-a147-87b0aaf6c5e5 could not be found. Aug 18 14:58:39.751559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:39.751559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:39.751559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:39.751559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:39.751559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:39.751559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:39.751559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:58:39.751559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:58:39.751559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:58:39.752957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:58:39.752957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 14:58:39.752957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 14:58:39.752957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 14:58:39.752957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 14:58:39.752957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:58:39.752957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:58:39.752957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:58:39.752957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:58:39.752957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9d85d35-e080-4901-a147-87b0aaf6c5e5 could not be found. Aug 18 14:58:39.752957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:39.752957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:39.752957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:39.752957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:39.752957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:39.752957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:39.752957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:58:39.752957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:58:39.752957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9d85d35-e080-4901-a147-87b0aaf6c5e5 could not be found. Aug 18 14:58:39.752957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:39.754360 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-893491a7-fc66-4fab-9e75-055b492d1c8a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Returning 404 to user: Instance c9d85d35-e080-4901-a147-87b0aaf6c5e5 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:58:39.754360 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-893491a7-fc66-4fab-9e75-055b492d1c8a tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 404 len: 111 microversion: 2.1 time: 0.031634 Aug 18 14:58:39.754360 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 701/963] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 14:58:39 2022] DELETE /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 14:58:39.758602 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-7f819067-66ca-4353-a883-fd7f3c22fe2c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:58:39.759210 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-7f819067-66ca-4353-a883-fd7f3c22fe2c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] [instance: c9d85d35-e080-4901-a147-87b0aaf6c5e5] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:58:39.765242 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7f819067-66ca-4353-a883-fd7f3c22fe2c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:39.765717 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7f819067-66ca-4353-a883-fd7f3c22fe2c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:39.766150 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7f819067-66ca-4353-a883-fd7f3c22fe2c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:39.766835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7f819067-66ca-4353-a883-fd7f3c22fe2c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:58:39.767293 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7f819067-66ca-4353-a883-fd7f3c22fe2c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:58:39.767754 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7f819067-66ca-4353-a883-fd7f3c22fe2c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:58:39.783823 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-7f819067-66ca-4353-a883-fd7f3c22fe2c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] HTTP exception thrown: Instance c9d85d35-e080-4901-a147-87b0aaf6c5e5 could not be found. Aug 18 14:58:39.785290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-7f819067-66ca-4353-a883-fd7f3c22fe2c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Request method failure captured: Aug 18 14:58:39.785290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 HTTP/1.1 Aug 18 14:58:39.785290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:58:39.785290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:58:39.785290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:58:39.785290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:58:39.785290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:58:39.785290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:58:39.785290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:58:39.785290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:58:39.785290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lH6BHXVVBz2bu2oI3N3lrYFUqap7g77I0qAQBxIqrO1qLF-L7AUzm1M2x4z2taZt045DURIw-nP_XJaZMwll8Au7wbfViaB3bev4Rw3_1RoqYXCk-UmoN76amBPnEJzgxY_Z3LPB7uMqWQN-lS61umlU4Vf17CSZL26XcnP1HzHBRU Aug 18 14:58:39.785290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:58:39.785290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:58:39.785290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:58:39.785290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:58:39.785290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:58:39.785290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:58:39.785290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: bde4e338430442449fcc203cd9493bc3 Aug 18 14:58:39.785290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-AttachVolumeTestJSON-1688587655 Aug 18 14:58:39.785290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:58:39.785290 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:58:39.787270 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bde4e338430442449fcc203cd9493bc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bde4e338430442449fcc203cd9493bc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bde4e338430442449fcc203cd9493bc3", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bde4e338430442449fcc203cd9493bc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:58:39.787270 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-AttachVolumeTestJSON-1688587655 Aug 18 14:58:39.787270 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: bde4e338430442449fcc203cd9493bc3 Aug 18 14:58:39.787270 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1688587655 Aug 18 14:58:39.787270 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-AttachVolumeTestJSON-1688587655-project Aug 18 14:58:39.787270 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:58:39.787270 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:58:39.787270 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 4d96208474754b2381d769d807689bbb Aug 18 14:58:39.787270 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-AttachVolumeTestJSON-1688587655-project Aug 18 14:58:39.787270 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:58:39.787270 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance c9d85d35-e080-4901-a147-87b0aaf6c5e5 could not be found. Aug 18 14:58:39.787270 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': 'c9d85d35-e080-4901-a147-87b0aaf6c5e5'} Aug 18 14:58:39.788054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:58:39.788054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:39.788054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:58:39.788054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:58:39.788054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:58:39.788054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:58:39.788054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:58:39.788054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:58:39.788054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:58:39.788054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:58:39.788054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9d85d35-e080-4901-a147-87b0aaf6c5e5 could not be found. Aug 18 14:58:39.788054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:39.788054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:39.788054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:39.788054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:39.788054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:39.788054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:39.788054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:58:39.788054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:58:39.788054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:58:39.789825 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:58:39.789825 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:58:39.789825 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:58:39.789825 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:58:39.789825 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:58:39.789825 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:58:39.789825 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:58:39.789825 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9d85d35-e080-4901-a147-87b0aaf6c5e5 could not be found. Aug 18 14:58:39.789825 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:39.789825 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:58:39.789825 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:39.789825 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:58:39.789825 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:58:39.789825 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:58:39.789825 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:58:39.789825 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:58:39.789825 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9d85d35-e080-4901-a147-87b0aaf6c5e5 could not be found. Aug 18 14:58:39.789825 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:58:39.792035 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-7f819067-66ca-4353-a883-fd7f3c22fe2c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] Returning 404 to user: Instance c9d85d35-e080-4901-a147-87b0aaf6c5e5 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:58:39.792035 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-7f819067-66ca-4353-a883-fd7f3c22fe2c tempest-AttachVolumeTestJSON-1688587655 tempest-AttachVolumeTestJSON-1688587655-project] 10.222.0.36 "GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5" status: 404 len: 111 microversion: 2.1 time: 0.032204 Aug 18 14:58:39.792035 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 702/964] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:58:39 2022] GET /compute/v2.1/servers/c9d85d35-e080-4901-a147-87b0aaf6c5e5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 14:59:01.171564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-7f5ed268-8aec-4f40-88ad-d9671957509e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1514135227", "imageRef": "4083d76b-6b95-4ed8-8053-69a1270afbd4", "flavorRef": "452"}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:59:01.180255 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=2 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:59:01.181158 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=34 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:59:01.251862 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.network.neutron [None req-7f5ed268-8aec-4f40-88ad-d9671957509e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] validate_networks() for None {{(pid=132268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:59:01.522362 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-7f5ed268-8aec-4f40-88ad-d9671957509e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Flavor limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:59:01.522782 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-7f5ed268-8aec-4f40-88ad-d9671957509e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Image limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:59:01.523286 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-7f5ed268-8aec-4f40-88ad-d9671957509e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Flavor pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:59:01.523705 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-7f5ed268-8aec-4f40-88ad-d9671957509e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Image pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:59:01.524125 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-7f5ed268-8aec-4f40-88ad-d9671957509e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:59:01.533145 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7f5ed268-8aec-4f40-88ad-d9671957509e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:01.533623 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7f5ed268-8aec-4f40-88ad-d9671957509e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:01.534071 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7f5ed268-8aec-4f40-88ad-d9671957509e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:01.534774 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7f5ed268-8aec-4f40-88ad-d9671957509e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:01.535231 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7f5ed268-8aec-4f40-88ad-d9671957509e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:01.536216 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7f5ed268-8aec-4f40-88ad-d9671957509e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:01.554041 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-7f5ed268-8aec-4f40-88ad-d9671957509e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Getting quotas for project c12ac892aa6b4154b90e992217298624. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:59:01.558042 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-7f5ed268-8aec-4f40-88ad-d9671957509e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Getting quotas for user 0bd506975b28441cae07cd3bceb04970 and project c12ac892aa6b4154b90e992217298624. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:59:01.569112 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-7f5ed268-8aec-4f40-88ad-d9671957509e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Going to run 1 instances... {{(pid=132268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:59:01.571453 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-7f5ed268-8aec-4f40-88ad-d9671957509e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] [instance: fbf5aab7-22fb-4ed2-b962-44353f41ffd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4083d76b-6b95-4ed8-8053-69a1270afbd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:59:01.614878 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-7f5ed268-8aec-4f40-88ad-d9671957509e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.447372 Aug 18 14:59:01.615569 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 703/965] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Aug 18 14:59:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 14:59:01.626898 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f70cac6e-522c-44b5-b1a8-f257c9b4c380 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:01.627622 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f70cac6e-522c-44b5-b1a8-f257c9b4c380 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] [instance: fbf5aab7-22fb-4ed2-b962-44353f41ffd8] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:01.694600 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f70cac6e-522c-44b5-b1a8-f257c9b4c380 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd506975b28441cae07cd3bceb04970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ac892aa6b4154b90e992217298624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:01.702221 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f70cac6e-522c-44b5-b1a8-f257c9b4c380 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] 10.222.0.36 "GET /compute/v2.1/servers/fbf5aab7-22fb-4ed2-b962-44353f41ffd8" status: 200 len: 1215 microversion: 2.1 time: 0.079153 Aug 18 14:59:01.702780 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 704/966] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:59:01 2022] GET /compute/v2.1/servers/fbf5aab7-22fb-4ed2-b962-44353f41ffd8 => generated 1215 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:59:02.722594 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c132d0c7-fb92-43f5-87af-d34e5c0fc72d tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:02.724156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c132d0c7-fb92-43f5-87af-d34e5c0fc72d tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] [instance: fbf5aab7-22fb-4ed2-b962-44353f41ffd8] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:02.731436 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c132d0c7-fb92-43f5-87af-d34e5c0fc72d tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:02.731957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c132d0c7-fb92-43f5-87af-d34e5c0fc72d tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:02.732450 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c132d0c7-fb92-43f5-87af-d34e5c0fc72d tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:02.733092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c132d0c7-fb92-43f5-87af-d34e5c0fc72d tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:02.733546 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c132d0c7-fb92-43f5-87af-d34e5c0fc72d tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:02.734099 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c132d0c7-fb92-43f5-87af-d34e5c0fc72d tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:03.079818 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c132d0c7-fb92-43f5-87af-d34e5c0fc72d tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd506975b28441cae07cd3bceb04970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ac892aa6b4154b90e992217298624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:03.088296 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c132d0c7-fb92-43f5-87af-d34e5c0fc72d tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] 10.222.0.36 "GET /compute/v2.1/servers/fbf5aab7-22fb-4ed2-b962-44353f41ffd8" status: 200 len: 1275 microversion: 2.1 time: 0.369661 Aug 18 14:59:03.088876 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 705/967] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:59:02 2022] GET /compute/v2.1/servers/fbf5aab7-22fb-4ed2-b962-44353f41ffd8 => generated 1275 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:59:04.109995 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-678ab291-c925-4b56-8f71-90250bae267d tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:04.110648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-678ab291-c925-4b56-8f71-90250bae267d tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] [instance: fbf5aab7-22fb-4ed2-b962-44353f41ffd8] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:04.118651 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-678ab291-c925-4b56-8f71-90250bae267d tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:04.119245 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-678ab291-c925-4b56-8f71-90250bae267d tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:04.119808 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-678ab291-c925-4b56-8f71-90250bae267d tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:04.120572 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-678ab291-c925-4b56-8f71-90250bae267d tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:04.121091 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-678ab291-c925-4b56-8f71-90250bae267d tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:04.121579 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-678ab291-c925-4b56-8f71-90250bae267d tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:04.255797 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-678ab291-c925-4b56-8f71-90250bae267d tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd506975b28441cae07cd3bceb04970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ac892aa6b4154b90e992217298624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:04.264174 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-678ab291-c925-4b56-8f71-90250bae267d tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] 10.222.0.36 "GET /compute/v2.1/servers/fbf5aab7-22fb-4ed2-b962-44353f41ffd8" status: 200 len: 1315 microversion: 2.1 time: 0.157712 Aug 18 14:59:04.264730 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 706/968] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:59:04 2022] GET /compute/v2.1/servers/fbf5aab7-22fb-4ed2-b962-44353f41ffd8 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:59:04.507904 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-569f605f-25b1-4c89-818d-1446ebee847c req-d7e7e0ad-1bdf-49e1-b9e6-ee720a3d1a79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbf5aab7-22fb-4ed2-b962-44353f41ffd8", "tag": "c455fcd9-e32c-4ef5-85c8-42eb271d359a"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:59:04.519246 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-569f605f-25b1-4c89-818d-1446ebee847c req-d7e7e0ad-1bdf-49e1-b9e6-ee720a3d1a79 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:04.520291 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-569f605f-25b1-4c89-818d-1446ebee847c req-d7e7e0ad-1bdf-49e1-b9e6-ee720a3d1a79 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:04.520719 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-569f605f-25b1-4c89-818d-1446ebee847c req-d7e7e0ad-1bdf-49e1-b9e6-ee720a3d1a79 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:04.533005 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-569f605f-25b1-4c89-818d-1446ebee847c req-d7e7e0ad-1bdf-49e1-b9e6-ee720a3d1a79 service nova] Creating event network-changed:c455fcd9-e32c-4ef5-85c8-42eb271d359a for instance fbf5aab7-22fb-4ed2-b962-44353f41ffd8 on hv-cinder-85220 Aug 18 14:59:04.538655 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-569f605f-25b1-4c89-818d-1446ebee847c req-d7e7e0ad-1bdf-49e1-b9e6-ee720a3d1a79 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034977 Aug 18 14:59:04.539246 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 707/969] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:59:05.285944 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-df3ecd32-2e86-4ea4-ad33-75c4c43a94f4 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:05.286572 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-df3ecd32-2e86-4ea4-ad33-75c4c43a94f4 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] [instance: fbf5aab7-22fb-4ed2-b962-44353f41ffd8] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:05.292999 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-df3ecd32-2e86-4ea4-ad33-75c4c43a94f4 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:05.293496 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-df3ecd32-2e86-4ea4-ad33-75c4c43a94f4 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:05.293946 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-df3ecd32-2e86-4ea4-ad33-75c4c43a94f4 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:05.294631 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-df3ecd32-2e86-4ea4-ad33-75c4c43a94f4 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:05.295084 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-df3ecd32-2e86-4ea4-ad33-75c4c43a94f4 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:05.295506 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-df3ecd32-2e86-4ea4-ad33-75c4c43a94f4 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:05.428438 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-df3ecd32-2e86-4ea4-ad33-75c4c43a94f4 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd506975b28441cae07cd3bceb04970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ac892aa6b4154b90e992217298624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:05.436178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-df3ecd32-2e86-4ea4-ad33-75c4c43a94f4 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] 10.222.0.36 "GET /compute/v2.1/servers/fbf5aab7-22fb-4ed2-b962-44353f41ffd8" status: 200 len: 1315 microversion: 2.1 time: 0.155067 Aug 18 14:59:05.436734 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 708/970] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:59:05 2022] GET /compute/v2.1/servers/fbf5aab7-22fb-4ed2-b962-44353f41ffd8 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:59:06.458025 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f3d5a2c7-2581-474a-9cad-e145d9b782f6 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:06.458706 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f3d5a2c7-2581-474a-9cad-e145d9b782f6 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] [instance: fbf5aab7-22fb-4ed2-b962-44353f41ffd8] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:06.465856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f3d5a2c7-2581-474a-9cad-e145d9b782f6 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:06.466344 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f3d5a2c7-2581-474a-9cad-e145d9b782f6 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:06.466780 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f3d5a2c7-2581-474a-9cad-e145d9b782f6 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:06.467484 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f3d5a2c7-2581-474a-9cad-e145d9b782f6 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:06.468088 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f3d5a2c7-2581-474a-9cad-e145d9b782f6 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:06.468689 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f3d5a2c7-2581-474a-9cad-e145d9b782f6 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:06.650269 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f3d5a2c7-2581-474a-9cad-e145d9b782f6 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd506975b28441cae07cd3bceb04970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ac892aa6b4154b90e992217298624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:06.680215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f3d5a2c7-2581-474a-9cad-e145d9b782f6 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] 10.222.0.36 "GET /compute/v2.1/servers/fbf5aab7-22fb-4ed2-b962-44353f41ffd8" status: 200 len: 1315 microversion: 2.1 time: 0.226428 Aug 18 14:59:06.680811 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 709/971] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:59:06 2022] GET /compute/v2.1/servers/fbf5aab7-22fb-4ed2-b962-44353f41ffd8 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:59:06.698889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-7cad590a-e273-4be6-96a6-4bf88b5034ca tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:06.701100 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-7cad590a-e273-4be6-96a6-4bf88b5034ca tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:06.708708 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7cad590a-e273-4be6-96a6-4bf88b5034ca tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:06.709569 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7cad590a-e273-4be6-96a6-4bf88b5034ca tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:06.710167 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7cad590a-e273-4be6-96a6-4bf88b5034ca tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:06.711046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7cad590a-e273-4be6-96a6-4bf88b5034ca tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:06.711663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7cad590a-e273-4be6-96a6-4bf88b5034ca tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:06.712260 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7cad590a-e273-4be6-96a6-4bf88b5034ca tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:06.746198 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-7cad590a-e273-4be6-96a6-4bf88b5034ca tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051481 Aug 18 14:59:06.747073 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 710/972] 10.222.0.36 () {60 vars in 1343 bytes} [Thu Aug 18 14:59:06 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:59:06.831372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f1a7181c-62a8-4420-9f0f-de9631e3aa70 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:06.832733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f1a7181c-62a8-4420-9f0f-de9631e3aa70 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:06.838679 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f1a7181c-62a8-4420-9f0f-de9631e3aa70 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:06.839421 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f1a7181c-62a8-4420-9f0f-de9631e3aa70 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:06.840235 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f1a7181c-62a8-4420-9f0f-de9631e3aa70 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:06.840937 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f1a7181c-62a8-4420-9f0f-de9631e3aa70 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:06.841691 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f1a7181c-62a8-4420-9f0f-de9631e3aa70 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:06.842122 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f1a7181c-62a8-4420-9f0f-de9631e3aa70 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:06.869835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f1a7181c-62a8-4420-9f0f-de9631e3aa70 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Going to try to terminate instance {{(pid=132268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:59:06.959516 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f1a7181c-62a8-4420-9f0f-de9631e3aa70 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 204 len: 0 microversion: 2.20 time: 0.131820 Aug 18 14:59:06.961389 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 711/973] 10.222.0.36 () {60 vars in 1280 bytes} [Thu Aug 18 14:59:06 2022] DELETE /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 18 14:59:06.970535 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-eb486786-56c3-4d8d-91df-43b03aac42fe tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:06.971284 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-eb486786-56c3-4d8d-91df-43b03aac42fe tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:06.977797 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-eb486786-56c3-4d8d-91df-43b03aac42fe tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:06.978327 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-eb486786-56c3-4d8d-91df-43b03aac42fe tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:06.978912 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-eb486786-56c3-4d8d-91df-43b03aac42fe tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:06.979748 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-eb486786-56c3-4d8d-91df-43b03aac42fe tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:06.980213 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-eb486786-56c3-4d8d-91df-43b03aac42fe tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:06.980676 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-eb486786-56c3-4d8d-91df-43b03aac42fe tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:07.171239 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-eb486786-56c3-4d8d-91df-43b03aac42fe tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:07.184620 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-eb486786-56c3-4d8d-91df-43b03aac42fe tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:07.187189 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-eb486786-56c3-4d8d-91df-43b03aac42fe tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:07.188502 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-eb486786-56c3-4d8d-91df-43b03aac42fe tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1722 microversion: 2.20 time: 0.222885 Aug 18 14:59:07.189440 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 712/974] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:59:06 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:59:07.700881 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-fb4c13ee-e5d2-4864-b66d-4f1a01d3dc24 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:07.701670 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-fb4c13ee-e5d2-4864-b66d-4f1a01d3dc24 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] [instance: fbf5aab7-22fb-4ed2-b962-44353f41ffd8] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:07.710879 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fb4c13ee-e5d2-4864-b66d-4f1a01d3dc24 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:07.711653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fb4c13ee-e5d2-4864-b66d-4f1a01d3dc24 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:07.712120 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fb4c13ee-e5d2-4864-b66d-4f1a01d3dc24 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:07.712825 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fb4c13ee-e5d2-4864-b66d-4f1a01d3dc24 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:07.713466 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fb4c13ee-e5d2-4864-b66d-4f1a01d3dc24 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:07.714062 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fb4c13ee-e5d2-4864-b66d-4f1a01d3dc24 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:07.862642 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-fb4c13ee-e5d2-4864-b66d-4f1a01d3dc24 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd506975b28441cae07cd3bceb04970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ac892aa6b4154b90e992217298624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:07.872022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-fb4c13ee-e5d2-4864-b66d-4f1a01d3dc24 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] 10.222.0.36 "GET /compute/v2.1/servers/fbf5aab7-22fb-4ed2-b962-44353f41ffd8" status: 200 len: 1315 microversion: 2.1 time: 0.174669 Aug 18 14:59:07.873037 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 713/975] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:59:07 2022] GET /compute/v2.1/servers/fbf5aab7-22fb-4ed2-b962-44353f41ffd8 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:59:08.212474 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-99391924-889a-493c-a3b0-038382137300 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:08.213354 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-99391924-889a-493c-a3b0-038382137300 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:08.219643 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-99391924-889a-493c-a3b0-038382137300 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:08.220191 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-99391924-889a-493c-a3b0-038382137300 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:08.220732 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-99391924-889a-493c-a3b0-038382137300 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:08.221544 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-99391924-889a-493c-a3b0-038382137300 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:08.222106 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-99391924-889a-493c-a3b0-038382137300 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:08.222603 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-99391924-889a-493c-a3b0-038382137300 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:08.385526 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-99391924-889a-493c-a3b0-038382137300 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:08.395406 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-99391924-889a-493c-a3b0-038382137300 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:08.397068 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-99391924-889a-493c-a3b0-038382137300 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:08.398512 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-99391924-889a-493c-a3b0-038382137300 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1722 microversion: 2.20 time: 0.190019 Aug 18 14:59:08.399178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 714/976] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:59:08 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:59:08.609904 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-c60768f5-526a-48a2-a1fa-51f9ea46c613 req-564d205b-01b8-43f7-830a-6b7683409b4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf5aab7-22fb-4ed2-b962-44353f41ffd8", "name": "network-vif-plugged", "status": "completed", "tag": "c455fcd9-e32c-4ef5-85c8-42eb271d359a"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:59:08.626481 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-c60768f5-526a-48a2-a1fa-51f9ea46c613 req-564d205b-01b8-43f7-830a-6b7683409b4c service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:08.630180 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-c60768f5-526a-48a2-a1fa-51f9ea46c613 req-564d205b-01b8-43f7-830a-6b7683409b4c service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:08.630637 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-c60768f5-526a-48a2-a1fa-51f9ea46c613 req-564d205b-01b8-43f7-830a-6b7683409b4c service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:08.661486 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-c60768f5-526a-48a2-a1fa-51f9ea46c613 req-564d205b-01b8-43f7-830a-6b7683409b4c service nova] Creating event network-vif-plugged:c455fcd9-e32c-4ef5-85c8-42eb271d359a for instance fbf5aab7-22fb-4ed2-b962-44353f41ffd8 on hv-cinder-85220 Aug 18 14:59:08.674137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-c60768f5-526a-48a2-a1fa-51f9ea46c613 req-564d205b-01b8-43f7-830a-6b7683409b4c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068959 Aug 18 14:59:08.675698 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 715/977] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:59:08.896166 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e0a192a8-ca12-4abe-bda8-d23a1876d66a tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:08.897924 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e0a192a8-ca12-4abe-bda8-d23a1876d66a tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] [instance: fbf5aab7-22fb-4ed2-b962-44353f41ffd8] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:08.911260 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e0a192a8-ca12-4abe-bda8-d23a1876d66a tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:08.913197 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e0a192a8-ca12-4abe-bda8-d23a1876d66a tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:08.916632 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e0a192a8-ca12-4abe-bda8-d23a1876d66a tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:08.917637 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e0a192a8-ca12-4abe-bda8-d23a1876d66a tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:08.919812 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e0a192a8-ca12-4abe-bda8-d23a1876d66a tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:08.920563 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e0a192a8-ca12-4abe-bda8-d23a1876d66a tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:09.128988 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e0a192a8-ca12-4abe-bda8-d23a1876d66a tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd506975b28441cae07cd3bceb04970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ac892aa6b4154b90e992217298624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:09.136946 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e0a192a8-ca12-4abe-bda8-d23a1876d66a tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] 10.222.0.36 "GET /compute/v2.1/servers/fbf5aab7-22fb-4ed2-b962-44353f41ffd8" status: 200 len: 1315 microversion: 2.1 time: 0.246137 Aug 18 14:59:09.137502 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 716/978] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:59:08 2022] GET /compute/v2.1/servers/fbf5aab7-22fb-4ed2-b962-44353f41ffd8 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:59:09.423101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-67b73133-c426-49b6-96b9-ec93c55b01fa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:09.423101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-67b73133-c426-49b6-96b9-ec93c55b01fa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:09.429724 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-67b73133-c426-49b6-96b9-ec93c55b01fa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:09.430205 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-67b73133-c426-49b6-96b9-ec93c55b01fa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:09.430626 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-67b73133-c426-49b6-96b9-ec93c55b01fa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:09.431555 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-67b73133-c426-49b6-96b9-ec93c55b01fa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:09.432216 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-67b73133-c426-49b6-96b9-ec93c55b01fa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:09.433141 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-67b73133-c426-49b6-96b9-ec93c55b01fa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:09.499263 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-67b73133-c426-49b6-96b9-ec93c55b01fa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:09.510565 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-67b73133-c426-49b6-96b9-ec93c55b01fa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:09.512553 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-67b73133-c426-49b6-96b9-ec93c55b01fa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:09.513971 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-67b73133-c426-49b6-96b9-ec93c55b01fa tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1654 microversion: 2.20 time: 0.095651 Aug 18 14:59:09.520351 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 717/979] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:59:09 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1654 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:59:09.653821 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-993e46e0-61cc-4f7f-8ad3-58573a5d4086 req-73fdc2fb-53d2-40ef-b91e-60b050352abe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cb0c027-abae-485d-a0b8-c57e5286d2b1", "name": "network-vif-deleted", "tag": "982d1ea2-1757-4ef9-9f00-9c88adcab716"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:59:09.663594 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-993e46e0-61cc-4f7f-8ad3-58573a5d4086 req-73fdc2fb-53d2-40ef-b91e-60b050352abe service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:09.664245 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-993e46e0-61cc-4f7f-8ad3-58573a5d4086 req-73fdc2fb-53d2-40ef-b91e-60b050352abe service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:09.664681 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-993e46e0-61cc-4f7f-8ad3-58573a5d4086 req-73fdc2fb-53d2-40ef-b91e-60b050352abe service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:09.677095 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-993e46e0-61cc-4f7f-8ad3-58573a5d4086 req-73fdc2fb-53d2-40ef-b91e-60b050352abe service nova] Creating event network-vif-deleted:982d1ea2-1757-4ef9-9f00-9c88adcab716 for instance 1cb0c027-abae-485d-a0b8-c57e5286d2b1 on hv-cinder-85220 Aug 18 14:59:09.686309 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-993e46e0-61cc-4f7f-8ad3-58573a5d4086 req-73fdc2fb-53d2-40ef-b91e-60b050352abe service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035886 Aug 18 14:59:09.687868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 718/980] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:59:10.165705 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-34e1fcc6-0ac9-49fe-95d9-37c1dc9ad289 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:10.167161 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-34e1fcc6-0ac9-49fe-95d9-37c1dc9ad289 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] [instance: fbf5aab7-22fb-4ed2-b962-44353f41ffd8] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:10.177178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-34e1fcc6-0ac9-49fe-95d9-37c1dc9ad289 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:10.177664 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-34e1fcc6-0ac9-49fe-95d9-37c1dc9ad289 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:10.178094 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-34e1fcc6-0ac9-49fe-95d9-37c1dc9ad289 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:10.178783 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-34e1fcc6-0ac9-49fe-95d9-37c1dc9ad289 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:10.180526 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-34e1fcc6-0ac9-49fe-95d9-37c1dc9ad289 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:10.181402 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-34e1fcc6-0ac9-49fe-95d9-37c1dc9ad289 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:10.374604 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-34e1fcc6-0ac9-49fe-95d9-37c1dc9ad289 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd506975b28441cae07cd3bceb04970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ac892aa6b4154b90e992217298624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:10.385548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-34e1fcc6-0ac9-49fe-95d9-37c1dc9ad289 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] 10.222.0.36 "GET /compute/v2.1/servers/fbf5aab7-22fb-4ed2-b962-44353f41ffd8" status: 200 len: 1464 microversion: 2.1 time: 0.229588 Aug 18 14:59:10.386294 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 719/981] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:59:10 2022] GET /compute/v2.1/servers/fbf5aab7-22fb-4ed2-b962-44353f41ffd8 => generated 1464 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:59:10.459808 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-62448cbd-f5fd-404e-8488-9ce117efc9ae tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:10.460321 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-62448cbd-f5fd-404e-8488-9ce117efc9ae tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] [instance: fbf5aab7-22fb-4ed2-b962-44353f41ffd8] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:10.471480 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-62448cbd-f5fd-404e-8488-9ce117efc9ae tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:10.472516 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-62448cbd-f5fd-404e-8488-9ce117efc9ae tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:10.473438 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-62448cbd-f5fd-404e-8488-9ce117efc9ae tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:10.474372 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-62448cbd-f5fd-404e-8488-9ce117efc9ae tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:10.475185 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-62448cbd-f5fd-404e-8488-9ce117efc9ae tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:10.475905 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-62448cbd-f5fd-404e-8488-9ce117efc9ae tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:10.512737 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-62448cbd-f5fd-404e-8488-9ce117efc9ae tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] [instance: fbf5aab7-22fb-4ed2-b962-44353f41ffd8] Going to try to terminate instance {{(pid=132268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:59:10.545974 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:59:10.614730 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-62448cbd-f5fd-404e-8488-9ce117efc9ae tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fbf5aab7-22fb-4ed2-b962-44353f41ffd8" status: 204 len: 0 microversion: 2.1 time: 0.158859 Aug 18 14:59:10.615402 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 720/982] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 14:59:10 2022] DELETE /compute/v2.1/servers/fbf5aab7-22fb-4ed2-b962-44353f41ffd8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 14:59:10.623723 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-50c9726a-8f07-4d19-be07-3053ff4110f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:10.624871 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-50c9726a-8f07-4d19-be07-3053ff4110f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:10.631385 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-50c9726a-8f07-4d19-be07-3053ff4110f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:10.631903 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-50c9726a-8f07-4d19-be07-3053ff4110f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:10.632335 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-50c9726a-8f07-4d19-be07-3053ff4110f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:10.633044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-50c9726a-8f07-4d19-be07-3053ff4110f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:10.633494 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-50c9726a-8f07-4d19-be07-3053ff4110f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:10.633946 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-50c9726a-8f07-4d19-be07-3053ff4110f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:10.668945 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-50c9726a-8f07-4d19-be07-3053ff4110f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:10.669435 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-50c9726a-8f07-4d19-be07-3053ff4110f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:10.670076 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-50c9726a-8f07-4d19-be07-3053ff4110f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:10.670575 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.objects.instance [None req-50c9726a-8f07-4d19-be07-3053ff4110f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lazy-loading 'fault' on Instance uuid 1cb0c027-abae-485d-a0b8-c57e5286d2b1 {{(pid=132268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:59:10.716586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-50c9726a-8f07-4d19-be07-3053ff4110f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:10.726518 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-50c9726a-8f07-4d19-be07-3053ff4110f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:10.728976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-50c9726a-8f07-4d19-be07-3053ff4110f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:10.731954 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-50c9726a-8f07-4d19-be07-3053ff4110f8 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1370 microversion: 2.20 time: 0.112245 Aug 18 14:59:10.733130 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 721/983] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:59:10 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1370 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:59:10.739783 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2c6b1166-a7f6-4b4e-bb58-5e89ee61e7c2 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:10.740727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2c6b1166-a7f6-4b4e-bb58-5e89ee61e7c2 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] [instance: fbf5aab7-22fb-4ed2-b962-44353f41ffd8] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:10.747504 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2c6b1166-a7f6-4b4e-bb58-5e89ee61e7c2 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:10.748429 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2c6b1166-a7f6-4b4e-bb58-5e89ee61e7c2 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:10.749022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2c6b1166-a7f6-4b4e-bb58-5e89ee61e7c2 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:10.750202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2c6b1166-a7f6-4b4e-bb58-5e89ee61e7c2 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:10.752264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2c6b1166-a7f6-4b4e-bb58-5e89ee61e7c2 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:10.752976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2c6b1166-a7f6-4b4e-bb58-5e89ee61e7c2 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:10.928991 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2c6b1166-a7f6-4b4e-bb58-5e89ee61e7c2 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd506975b28441cae07cd3bceb04970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ac892aa6b4154b90e992217298624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:10.937863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2c6b1166-a7f6-4b4e-bb58-5e89ee61e7c2 tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] 10.222.0.36 "GET /compute/v2.1/servers/fbf5aab7-22fb-4ed2-b962-44353f41ffd8" status: 200 len: 1470 microversion: 2.1 time: 0.203318 Aug 18 14:59:10.938497 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 722/984] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:59:10 2022] GET /compute/v2.1/servers/fbf5aab7-22fb-4ed2-b962-44353f41ffd8 => generated 1470 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:59:11.756065 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-54ecf3f9-848e-494d-80ba-b993a3e4cbaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:11.756650 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-54ecf3f9-848e-494d-80ba-b993a3e4cbaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:11.760001 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=2 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:59:11.760731 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=8 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:59:11.764810 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-54ecf3f9-848e-494d-80ba-b993a3e4cbaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:11.765288 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-54ecf3f9-848e-494d-80ba-b993a3e4cbaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:11.765730 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-54ecf3f9-848e-494d-80ba-b993a3e4cbaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:11.766425 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-54ecf3f9-848e-494d-80ba-b993a3e4cbaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:11.766896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-54ecf3f9-848e-494d-80ba-b993a3e4cbaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:11.767329 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-54ecf3f9-848e-494d-80ba-b993a3e4cbaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:11.800241 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-54ecf3f9-848e-494d-80ba-b993a3e4cbaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:11.800711 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-54ecf3f9-848e-494d-80ba-b993a3e4cbaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:11.801138 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-54ecf3f9-848e-494d-80ba-b993a3e4cbaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:11.801574 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.objects.instance [None req-54ecf3f9-848e-494d-80ba-b993a3e4cbaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lazy-loading 'fault' on Instance uuid 1cb0c027-abae-485d-a0b8-c57e5286d2b1 {{(pid=132268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:59:11.845023 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-54ecf3f9-848e-494d-80ba-b993a3e4cbaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:11.853800 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-54ecf3f9-848e-494d-80ba-b993a3e4cbaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:11.855294 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-54ecf3f9-848e-494d-80ba-b993a3e4cbaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b055bb15ce4b2ab4276b0090e16122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '594f04dadf2a45fcb5fe2a80744cb9e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:11.856476 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-54ecf3f9-848e-494d-80ba-b993a3e4cbaf tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 200 len: 1370 microversion: 2.20 time: 0.104945 Aug 18 14:59:11.857029 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 723/985] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:59:11 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 1370 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:59:11.960448 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-1111dc27-0f0c-4779-beac-2fc7e0285a5e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:11.961078 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-1111dc27-0f0c-4779-beac-2fc7e0285a5e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] [instance: fbf5aab7-22fb-4ed2-b962-44353f41ffd8] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:11.967770 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1111dc27-0f0c-4779-beac-2fc7e0285a5e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:11.968262 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1111dc27-0f0c-4779-beac-2fc7e0285a5e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:11.968833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1111dc27-0f0c-4779-beac-2fc7e0285a5e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:11.969733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1111dc27-0f0c-4779-beac-2fc7e0285a5e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:11.970204 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1111dc27-0f0c-4779-beac-2fc7e0285a5e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:11.970628 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1111dc27-0f0c-4779-beac-2fc7e0285a5e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:12.117513 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-1111dc27-0f0c-4779-beac-2fc7e0285a5e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd506975b28441cae07cd3bceb04970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ac892aa6b4154b90e992217298624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:12.125803 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-1111dc27-0f0c-4779-beac-2fc7e0285a5e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] 10.222.0.36 "GET /compute/v2.1/servers/fbf5aab7-22fb-4ed2-b962-44353f41ffd8" status: 200 len: 1470 microversion: 2.1 time: 0.169604 Aug 18 14:59:12.126345 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 724/986] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:59:11 2022] GET /compute/v2.1/servers/fbf5aab7-22fb-4ed2-b962-44353f41ffd8 => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:59:12.880394 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-58f5bb4b-0aa2-4541-a132-abb24d51e73c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:12.881802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-58f5bb4b-0aa2-4541-a132-abb24d51e73c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:12.890439 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-58f5bb4b-0aa2-4541-a132-abb24d51e73c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:12.891101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-58f5bb4b-0aa2-4541-a132-abb24d51e73c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:12.891769 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-58f5bb4b-0aa2-4541-a132-abb24d51e73c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:12.892624 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-58f5bb4b-0aa2-4541-a132-abb24d51e73c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:12.893250 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-58f5bb4b-0aa2-4541-a132-abb24d51e73c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:12.893827 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-58f5bb4b-0aa2-4541-a132-abb24d51e73c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:12.935373 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-58f5bb4b-0aa2-4541-a132-abb24d51e73c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] HTTP exception thrown: Instance 1cb0c027-abae-485d-a0b8-c57e5286d2b1 could not be found. Aug 18 14:59:12.937160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-58f5bb4b-0aa2-4541-a132-abb24d51e73c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Request method failure captured: Aug 18 14:59:12.937160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 HTTP/1.1 Aug 18 14:59:12.937160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:59:12.937160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:59:12.937160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:59:12.937160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:59:12.937160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:59:12.937160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:59:12.937160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:59:12.937160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:59:12.937160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lH7zwFk8WrSTq6G01PM-9lXg9vxcQiJ2OXlNoO1fAQLssQJV-ZtF70LsGcxCBcKb3x3HtoOGVR9BN0TQGYehGA18R5A7qbUo3jtyF51HoVtsQj6so1ZYXbs3LvwW_nbOeN96fl4KGf_ya0nqGdS1LevxLlzbdB2w-QN91VI4eRRfs8 Aug 18 14:59:12.937160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:59:12.937160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:59:12.937160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:59:12.937160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:59:12.937160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 14:59:12.937160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:59:12.937160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:59:12.937160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: 594f04dadf2a45fcb5fe2a80744cb9e6 Aug 18 14:59:12.937160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-18518996 Aug 18 14:59:12.937160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:59:12.937160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:59:12.938717 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/594f04dadf2a45fcb5fe2a80744cb9e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/594f04dadf2a45fcb5fe2a80744cb9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_594f04dadf2a45fcb5fe2a80744cb9e6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/594f04dadf2a45fcb5fe2a80744cb9e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:59:12.938717 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-AttachVolumeShelveTestJSON-18518996 Aug 18 14:59:12.938717 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: 594f04dadf2a45fcb5fe2a80744cb9e6 Aug 18 14:59:12.938717 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-18518996 Aug 18 14:59:12.938717 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-AttachVolumeShelveTestJSON-18518996-project Aug 18 14:59:12.938717 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:59:12.938717 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:59:12.938717 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 09b055bb15ce4b2ab4276b0090e16122 Aug 18 14:59:12.938717 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-AttachVolumeShelveTestJSON-18518996-project Aug 18 14:59:12.938717 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:59:12.938717 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 1cb0c027-abae-485d-a0b8-c57e5286d2b1 could not be found. Aug 18 14:59:12.938717 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '1cb0c027-abae-485d-a0b8-c57e5286d2b1'} Aug 18 14:59:12.939653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:59:12.939653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:59:12.939653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:59:12.939653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:59:12.939653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:59:12.939653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:59:12.939653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:59:12.939653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:59:12.939653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:59:12.939653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:59:12.939653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cb0c027-abae-485d-a0b8-c57e5286d2b1 could not be found. Aug 18 14:59:12.939653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:12.939653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:59:12.939653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:12.939653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:59:12.939653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:59:12.939653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:59:12.939653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:59:12.939653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:59:12.939653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:59:12.941256 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:59:12.941256 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:59:12.941256 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:59:12.941256 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:59:12.941256 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:59:12.941256 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:59:12.941256 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:59:12.941256 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cb0c027-abae-485d-a0b8-c57e5286d2b1 could not be found. Aug 18 14:59:12.941256 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:12.941256 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:59:12.941256 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:12.941256 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:59:12.941256 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:59:12.941256 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:59:12.941256 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:59:12.941256 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:59:12.941256 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cb0c027-abae-485d-a0b8-c57e5286d2b1 could not be found. Aug 18 14:59:12.941256 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:12.944050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-58f5bb4b-0aa2-4541-a132-abb24d51e73c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Returning 404 to user: Instance 1cb0c027-abae-485d-a0b8-c57e5286d2b1 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:59:12.945107 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-58f5bb4b-0aa2-4541-a132-abb24d51e73c tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 404 len: 111 microversion: 2.20 time: 0.069155 Aug 18 14:59:12.946129 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 725/987] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:59:12 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 18 14:59:12.956170 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-1bd1b3c7-2e37-4594-a586-f8218489c09b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '.version_select at 0x7fb214434940>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:12.992311 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-1bd1b3c7-2e37-4594-a586-f8218489c09b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-860120649" status: 204 len: 0 microversion: 2.20 time: 0.041413 Aug 18 14:59:12.999294 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 726/988] 10.222.0.36 () {60 vars in 1259 bytes} [Thu Aug 18 14:59:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-860120649 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 18 14:59:13.075139 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-aad7f2f0-2aa8-4365-b7e0-d6f8e5abab52 req-bdd5302d-67d1-4c55-b40a-1e1fcf50b5b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf5aab7-22fb-4ed2-b962-44353f41ffd8", "name": "network-vif-deleted", "tag": "c455fcd9-e32c-4ef5-85c8-42eb271d359a"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:59:13.101537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-aad7f2f0-2aa8-4365-b7e0-d6f8e5abab52 req-bdd5302d-67d1-4c55-b40a-1e1fcf50b5b6 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:13.102313 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-aad7f2f0-2aa8-4365-b7e0-d6f8e5abab52 req-bdd5302d-67d1-4c55-b40a-1e1fcf50b5b6 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:13.103192 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-aad7f2f0-2aa8-4365-b7e0-d6f8e5abab52 req-bdd5302d-67d1-4c55-b40a-1e1fcf50b5b6 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:13.118483 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-aad7f2f0-2aa8-4365-b7e0-d6f8e5abab52 req-bdd5302d-67d1-4c55-b40a-1e1fcf50b5b6 service nova] Creating event network-vif-deleted:c455fcd9-e32c-4ef5-85c8-42eb271d359a for instance fbf5aab7-22fb-4ed2-b962-44353f41ffd8 on hv-cinder-85220 Aug 18 14:59:13.131812 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-aad7f2f0-2aa8-4365-b7e0-d6f8e5abab52 req-bdd5302d-67d1-4c55-b40a-1e1fcf50b5b6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059779 Aug 18 14:59:13.134283 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 727/989] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:59:13.154039 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f8b3a27f-1847-46e4-a2ae-9f9953892e6e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:13.155253 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f8b3a27f-1847-46e4-a2ae-9f9953892e6e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] [instance: fbf5aab7-22fb-4ed2-b962-44353f41ffd8] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:13.166742 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f8b3a27f-1847-46e4-a2ae-9f9953892e6e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:13.167517 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f8b3a27f-1847-46e4-a2ae-9f9953892e6e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:13.168130 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f8b3a27f-1847-46e4-a2ae-9f9953892e6e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:13.169025 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f8b3a27f-1847-46e4-a2ae-9f9953892e6e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:13.170130 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f8b3a27f-1847-46e4-a2ae-9f9953892e6e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:13.170714 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f8b3a27f-1847-46e4-a2ae-9f9953892e6e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:13.286823 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f8b3a27f-1847-46e4-a2ae-9f9953892e6e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd506975b28441cae07cd3bceb04970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ac892aa6b4154b90e992217298624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:13.295779 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f8b3a27f-1847-46e4-a2ae-9f9953892e6e tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] 10.222.0.36 "GET /compute/v2.1/servers/fbf5aab7-22fb-4ed2-b962-44353f41ffd8" status: 200 len: 1300 microversion: 2.1 time: 0.147824 Aug 18 14:59:13.296488 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 728/990] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:59:13 2022] GET /compute/v2.1/servers/fbf5aab7-22fb-4ed2-b962-44353f41ffd8 => generated 1300 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:59:14.317716 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f5ac33ab-85ce-4810-9326-5c3954da1dbe tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:14.318905 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f5ac33ab-85ce-4810-9326-5c3954da1dbe tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] [instance: fbf5aab7-22fb-4ed2-b962-44353f41ffd8] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:14.328056 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f5ac33ab-85ce-4810-9326-5c3954da1dbe tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:14.328730 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f5ac33ab-85ce-4810-9326-5c3954da1dbe tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:14.329336 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f5ac33ab-85ce-4810-9326-5c3954da1dbe tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:14.330193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f5ac33ab-85ce-4810-9326-5c3954da1dbe tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:14.330670 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f5ac33ab-85ce-4810-9326-5c3954da1dbe tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:14.331094 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f5ac33ab-85ce-4810-9326-5c3954da1dbe tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:14.345724 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-f5ac33ab-85ce-4810-9326-5c3954da1dbe tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] HTTP exception thrown: Instance fbf5aab7-22fb-4ed2-b962-44353f41ffd8 could not be found. Aug 18 14:59:14.347663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f5ac33ab-85ce-4810-9326-5c3954da1dbe tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Request method failure captured: Aug 18 14:59:14.347663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/fbf5aab7-22fb-4ed2-b962-44353f41ffd8 HTTP/1.1 Aug 18 14:59:14.347663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:59:14.347663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:59:14.347663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:59:14.347663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:59:14.347663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:59:14.347663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:59:14.347663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:59:14.347663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:59:14.347663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lOzd4X2c7nZgmBcMM9BtkUJ8jQiqW0AqGIIUT6Ff6YR_iydSxTogIxuDRIc-JRRkc2ZC8d0FDMnq_q3s0rrsuNLdFNoBj6nHaXq8AD0-LFOHiZtYzQI9b-OcvV3OfHiVWkwbY92724sG4cZjH9p5z14sl6tHaYuoBOytgQb1CC0LEU Aug 18 14:59:14.347663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:59:14.347663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:59:14.347663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:59:14.347663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:59:14.347663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:59:14.347663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:59:14.347663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: c12ac892aa6b4154b90e992217298624 Aug 18 14:59:14.347663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-VolumesNegativeTest-349109175 Aug 18 14:59:14.347663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:59:14.347663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:59:14.350030 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c12ac892aa6b4154b90e992217298624"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c12ac892aa6b4154b90e992217298624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c12ac892aa6b4154b90e992217298624", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c12ac892aa6b4154b90e992217298624"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:59:14.350030 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-VolumesNegativeTest-349109175 Aug 18 14:59:14.350030 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: c12ac892aa6b4154b90e992217298624 Aug 18 14:59:14.350030 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-VolumesNegativeTest-349109175 Aug 18 14:59:14.350030 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-VolumesNegativeTest-349109175-project Aug 18 14:59:14.350030 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:59:14.350030 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:59:14.350030 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 0bd506975b28441cae07cd3bceb04970 Aug 18 14:59:14.350030 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-VolumesNegativeTest-349109175-project Aug 18 14:59:14.350030 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:59:14.350030 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance fbf5aab7-22fb-4ed2-b962-44353f41ffd8 could not be found. Aug 18 14:59:14.350030 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': 'fbf5aab7-22fb-4ed2-b962-44353f41ffd8'} Aug 18 14:59:14.351172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:59:14.351172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:59:14.351172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:59:14.351172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:59:14.351172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:59:14.351172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:59:14.351172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:59:14.351172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:59:14.351172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:59:14.351172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:59:14.351172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbf5aab7-22fb-4ed2-b962-44353f41ffd8 could not be found. Aug 18 14:59:14.351172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:14.351172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:59:14.351172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:14.351172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:59:14.351172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:59:14.351172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:59:14.351172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:59:14.351172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:59:14.351172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:59:14.352445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:59:14.352445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:59:14.352445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:59:14.352445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:59:14.352445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:59:14.352445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:59:14.352445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:59:14.352445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbf5aab7-22fb-4ed2-b962-44353f41ffd8 could not be found. Aug 18 14:59:14.352445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:14.352445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:59:14.352445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:14.352445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:59:14.352445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:59:14.352445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:59:14.352445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:59:14.352445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:59:14.352445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbf5aab7-22fb-4ed2-b962-44353f41ffd8 could not be found. Aug 18 14:59:14.352445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:14.353569 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f5ac33ab-85ce-4810-9326-5c3954da1dbe tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] Returning 404 to user: Instance fbf5aab7-22fb-4ed2-b962-44353f41ffd8 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:59:14.353569 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f5ac33ab-85ce-4810-9326-5c3954da1dbe tempest-VolumesNegativeTest-349109175 tempest-VolumesNegativeTest-349109175-project] 10.222.0.36 "GET /compute/v2.1/servers/fbf5aab7-22fb-4ed2-b962-44353f41ffd8" status: 404 len: 111 microversion: 2.1 time: 0.036914 Aug 18 14:59:14.353569 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 729/991] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:59:14 2022] GET /compute/v2.1/servers/fbf5aab7-22fb-4ed2-b962-44353f41ffd8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 14:59:15.039358 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-933b5e02-c10b-46df-81d0-1a5d65637173 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:15.039895 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-933b5e02-c10b-46df-81d0-1a5d65637173 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:15.055957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-933b5e02-c10b-46df-81d0-1a5d65637173 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:15.056677 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-933b5e02-c10b-46df-81d0-1a5d65637173 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:15.057443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-933b5e02-c10b-46df-81d0-1a5d65637173 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:15.058586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-933b5e02-c10b-46df-81d0-1a5d65637173 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:15.059217 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-933b5e02-c10b-46df-81d0-1a5d65637173 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:15.060531 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-933b5e02-c10b-46df-81d0-1a5d65637173 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:15.078450 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-933b5e02-c10b-46df-81d0-1a5d65637173 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] HTTP exception thrown: Instance 1cb0c027-abae-485d-a0b8-c57e5286d2b1 could not be found. Aug 18 14:59:15.080050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-933b5e02-c10b-46df-81d0-1a5d65637173 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Request method failure captured: Aug 18 14:59:15.080050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: DELETE /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 HTTP/1.1 Aug 18 14:59:15.080050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:59:15.080050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:59:15.080050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:59:15.080050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:59:15.080050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:59:15.080050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:59:15.080050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:59:15.080050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:59:15.080050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lH7zwFk8WrSTq6G01PM-9lXg9vxcQiJ2OXlNoO1fAQLssQJV-ZtF70LsGcxCBcKb3x3HtoOGVR9BN0TQGYehGA18R5A7qbUo3jtyF51HoVtsQj6so1ZYXbs3LvwW_nbOeN96fl4KGf_ya0nqGdS1LevxLlzbdB2w-QN91VI4eRRfs8 Aug 18 14:59:15.080050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:59:15.080050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:59:15.080050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:59:15.080050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:59:15.080050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 14:59:15.080050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:59:15.080050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:59:15.080050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: 594f04dadf2a45fcb5fe2a80744cb9e6 Aug 18 14:59:15.080050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-18518996 Aug 18 14:59:15.080050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:59:15.080050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:59:15.081375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/594f04dadf2a45fcb5fe2a80744cb9e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/594f04dadf2a45fcb5fe2a80744cb9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_594f04dadf2a45fcb5fe2a80744cb9e6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/594f04dadf2a45fcb5fe2a80744cb9e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:59:15.081375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-AttachVolumeShelveTestJSON-18518996 Aug 18 14:59:15.081375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: 594f04dadf2a45fcb5fe2a80744cb9e6 Aug 18 14:59:15.081375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-18518996 Aug 18 14:59:15.081375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-AttachVolumeShelveTestJSON-18518996-project Aug 18 14:59:15.081375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:59:15.081375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:59:15.081375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 09b055bb15ce4b2ab4276b0090e16122 Aug 18 14:59:15.081375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-AttachVolumeShelveTestJSON-18518996-project Aug 18 14:59:15.081375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:59:15.081375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 1cb0c027-abae-485d-a0b8-c57e5286d2b1 could not be found. Aug 18 14:59:15.081375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '1cb0c027-abae-485d-a0b8-c57e5286d2b1'} Aug 18 14:59:15.082645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:59:15.082645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:59:15.082645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:59:15.082645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:59:15.082645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:59:15.082645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:59:15.082645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:59:15.082645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:59:15.082645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:59:15.082645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:59:15.082645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cb0c027-abae-485d-a0b8-c57e5286d2b1 could not be found. Aug 18 14:59:15.082645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:15.082645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:59:15.082645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:15.082645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:59:15.082645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:59:15.082645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:59:15.082645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:59:15.082645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:59:15.082645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:59:15.084137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:59:15.084137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 14:59:15.084137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 14:59:15.084137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 14:59:15.084137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 14:59:15.084137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:59:15.084137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:59:15.084137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:59:15.084137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:59:15.084137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cb0c027-abae-485d-a0b8-c57e5286d2b1 could not be found. Aug 18 14:59:15.084137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:15.084137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:59:15.084137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:15.084137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:59:15.084137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:59:15.084137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:59:15.084137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:59:15.084137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:59:15.084137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cb0c027-abae-485d-a0b8-c57e5286d2b1 could not be found. Aug 18 14:59:15.084137 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:15.085508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-933b5e02-c10b-46df-81d0-1a5d65637173 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Returning 404 to user: Instance 1cb0c027-abae-485d-a0b8-c57e5286d2b1 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:59:15.085508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-933b5e02-c10b-46df-81d0-1a5d65637173 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 404 len: 111 microversion: 2.20 time: 0.046537 Aug 18 14:59:15.085508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 730/992] 10.222.0.36 () {60 vars in 1280 bytes} [Thu Aug 18 14:59:15 2022] DELETE /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 18 14:59:15.090300 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-7789e974-6148-4d83-b704-b71dc4942aeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:15.090938 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-7789e974-6148-4d83-b704-b71dc4942aeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 1cb0c027-abae-485d-a0b8-c57e5286d2b1] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:15.099159 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7789e974-6148-4d83-b704-b71dc4942aeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:15.099653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7789e974-6148-4d83-b704-b71dc4942aeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:15.100125 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7789e974-6148-4d83-b704-b71dc4942aeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:15.100832 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7789e974-6148-4d83-b704-b71dc4942aeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:15.101607 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7789e974-6148-4d83-b704-b71dc4942aeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:15.101707 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7789e974-6148-4d83-b704-b71dc4942aeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:15.115936 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-7789e974-6148-4d83-b704-b71dc4942aeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] HTTP exception thrown: Instance 1cb0c027-abae-485d-a0b8-c57e5286d2b1 could not be found. Aug 18 14:59:15.117559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-7789e974-6148-4d83-b704-b71dc4942aeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Request method failure captured: Aug 18 14:59:15.117559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 HTTP/1.1 Aug 18 14:59:15.117559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:59:15.117559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:59:15.117559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:59:15.117559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:59:15.117559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:59:15.117559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:59:15.117559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:59:15.117559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:59:15.117559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lH7zwFk8WrSTq6G01PM-9lXg9vxcQiJ2OXlNoO1fAQLssQJV-ZtF70LsGcxCBcKb3x3HtoOGVR9BN0TQGYehGA18R5A7qbUo3jtyF51HoVtsQj6so1ZYXbs3LvwW_nbOeN96fl4KGf_ya0nqGdS1LevxLlzbdB2w-QN91VI4eRRfs8 Aug 18 14:59:15.117559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:59:15.117559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:59:15.117559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:59:15.117559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:59:15.117559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 14:59:15.117559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:59:15.117559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:59:15.117559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: 594f04dadf2a45fcb5fe2a80744cb9e6 Aug 18 14:59:15.117559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-18518996 Aug 18 14:59:15.117559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:59:15.117559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:59:15.119320 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/594f04dadf2a45fcb5fe2a80744cb9e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/594f04dadf2a45fcb5fe2a80744cb9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_594f04dadf2a45fcb5fe2a80744cb9e6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/594f04dadf2a45fcb5fe2a80744cb9e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:59:15.119320 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-AttachVolumeShelveTestJSON-18518996 Aug 18 14:59:15.119320 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: 594f04dadf2a45fcb5fe2a80744cb9e6 Aug 18 14:59:15.119320 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-18518996 Aug 18 14:59:15.119320 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-AttachVolumeShelveTestJSON-18518996-project Aug 18 14:59:15.119320 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:59:15.119320 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:59:15.119320 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 09b055bb15ce4b2ab4276b0090e16122 Aug 18 14:59:15.119320 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-AttachVolumeShelveTestJSON-18518996-project Aug 18 14:59:15.119320 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:59:15.119320 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 1cb0c027-abae-485d-a0b8-c57e5286d2b1 could not be found. Aug 18 14:59:15.119320 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '1cb0c027-abae-485d-a0b8-c57e5286d2b1'} Aug 18 14:59:15.120282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:59:15.120282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:59:15.120282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:59:15.120282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:59:15.120282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:59:15.120282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:59:15.120282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:59:15.120282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:59:15.120282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:59:15.120282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:59:15.120282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cb0c027-abae-485d-a0b8-c57e5286d2b1 could not be found. Aug 18 14:59:15.120282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:15.120282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:59:15.120282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:15.120282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:59:15.120282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:59:15.120282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:59:15.120282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:59:15.120282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:59:15.120282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:59:15.121733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:59:15.121733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:59:15.121733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:59:15.121733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:59:15.121733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:59:15.121733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:59:15.121733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:59:15.121733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cb0c027-abae-485d-a0b8-c57e5286d2b1 could not be found. Aug 18 14:59:15.121733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:15.121733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:59:15.121733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:15.121733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:59:15.121733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:59:15.121733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:59:15.121733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:59:15.121733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:59:15.121733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cb0c027-abae-485d-a0b8-c57e5286d2b1 could not be found. Aug 18 14:59:15.121733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:15.122900 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-7789e974-6148-4d83-b704-b71dc4942aeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Returning 404 to user: Instance 1cb0c027-abae-485d-a0b8-c57e5286d2b1 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:59:15.122900 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-7789e974-6148-4d83-b704-b71dc4942aeb tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1" status: 404 len: 111 microversion: 2.20 time: 0.032439 Aug 18 14:59:15.122900 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 731/993] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:59:15 2022] GET /compute/v2.1/servers/1cb0c027-abae-485d-a0b8-c57e5286d2b1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 14:59:16.299602 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d988b245-509b-4d8b-8ecb-437153efdf4b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:16.300197 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d988b245-509b-4d8b-8ecb-437153efdf4b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:16.307700 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d988b245-509b-4d8b-8ecb-437153efdf4b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:16.308200 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d988b245-509b-4d8b-8ecb-437153efdf4b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:16.308639 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d988b245-509b-4d8b-8ecb-437153efdf4b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:16.309508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d988b245-509b-4d8b-8ecb-437153efdf4b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:16.309968 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d988b245-509b-4d8b-8ecb-437153efdf4b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:16.312030 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d988b245-509b-4d8b-8ecb-437153efdf4b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:16.327939 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-d988b245-509b-4d8b-8ecb-437153efdf4b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] HTTP exception thrown: Instance 3d2b6fc4-0338-4141-9ac3-7b579718fae9 could not be found. Aug 18 14:59:16.329873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d988b245-509b-4d8b-8ecb-437153efdf4b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Request method failure captured: Aug 18 14:59:16.329873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: DELETE /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 HTTP/1.1 Aug 18 14:59:16.329873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:59:16.329873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:59:16.329873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:59:16.329873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:59:16.329873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:59:16.329873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:59:16.329873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:59:16.329873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:59:16.329873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lH7zwFk8WrSTq6G01PM-9lXg9vxcQiJ2OXlNoO1fAQLssQJV-ZtF70LsGcxCBcKb3x3HtoOGVR9BN0TQGYehGA18R5A7qbUo3jtyF51HoVtsQj6so1ZYXbs3LvwW_nbOeN96fl4KGf_ya0nqGdS1LevxLlzbdB2w-QN91VI4eRRfs8 Aug 18 14:59:16.329873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:59:16.329873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:59:16.329873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:59:16.329873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:59:16.329873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 14:59:16.329873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:59:16.329873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:59:16.329873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: 594f04dadf2a45fcb5fe2a80744cb9e6 Aug 18 14:59:16.329873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-18518996 Aug 18 14:59:16.329873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:59:16.329873 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:59:16.331292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/594f04dadf2a45fcb5fe2a80744cb9e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/594f04dadf2a45fcb5fe2a80744cb9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_594f04dadf2a45fcb5fe2a80744cb9e6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/594f04dadf2a45fcb5fe2a80744cb9e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:59:16.331292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-AttachVolumeShelveTestJSON-18518996 Aug 18 14:59:16.331292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: 594f04dadf2a45fcb5fe2a80744cb9e6 Aug 18 14:59:16.331292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-18518996 Aug 18 14:59:16.331292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-AttachVolumeShelveTestJSON-18518996-project Aug 18 14:59:16.331292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:59:16.331292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:59:16.331292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 09b055bb15ce4b2ab4276b0090e16122 Aug 18 14:59:16.331292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-AttachVolumeShelveTestJSON-18518996-project Aug 18 14:59:16.331292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:59:16.331292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 3d2b6fc4-0338-4141-9ac3-7b579718fae9 could not be found. Aug 18 14:59:16.331292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '3d2b6fc4-0338-4141-9ac3-7b579718fae9'} Aug 18 14:59:16.332124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:59:16.332124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:59:16.332124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:59:16.332124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:59:16.332124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:59:16.332124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:59:16.332124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:59:16.332124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:59:16.332124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:59:16.332124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:59:16.332124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d2b6fc4-0338-4141-9ac3-7b579718fae9 could not be found. Aug 18 14:59:16.332124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:16.332124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:59:16.332124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:16.332124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:59:16.332124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:59:16.332124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:59:16.332124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:59:16.332124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:59:16.332124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:59:16.333419 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:59:16.333419 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 14:59:16.333419 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 14:59:16.333419 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 14:59:16.333419 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 14:59:16.333419 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:59:16.333419 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:59:16.333419 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:59:16.333419 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:59:16.333419 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d2b6fc4-0338-4141-9ac3-7b579718fae9 could not be found. Aug 18 14:59:16.333419 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:16.333419 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:59:16.333419 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:16.333419 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:59:16.333419 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:59:16.333419 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:59:16.333419 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:59:16.333419 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:59:16.333419 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d2b6fc4-0338-4141-9ac3-7b579718fae9 could not be found. Aug 18 14:59:16.333419 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:16.334683 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d988b245-509b-4d8b-8ecb-437153efdf4b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Returning 404 to user: Instance 3d2b6fc4-0338-4141-9ac3-7b579718fae9 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:59:16.334683 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d988b245-509b-4d8b-8ecb-437153efdf4b tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 404 len: 111 microversion: 2.20 time: 0.036392 Aug 18 14:59:16.334683 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 732/994] 10.222.0.36 () {60 vars in 1280 bytes} [Thu Aug 18 14:59:16 2022] DELETE /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 14:59:16.340583 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8b8cc5b1-90bf-4402-87b1-15f3e73c9dc0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:16.341289 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-8b8cc5b1-90bf-4402-87b1-15f3e73c9dc0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] [instance: 3d2b6fc4-0338-4141-9ac3-7b579718fae9] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:16.349343 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b8cc5b1-90bf-4402-87b1-15f3e73c9dc0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:16.349980 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b8cc5b1-90bf-4402-87b1-15f3e73c9dc0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:16.350524 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b8cc5b1-90bf-4402-87b1-15f3e73c9dc0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:16.351446 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b8cc5b1-90bf-4402-87b1-15f3e73c9dc0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:16.352140 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b8cc5b1-90bf-4402-87b1-15f3e73c9dc0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:16.352793 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b8cc5b1-90bf-4402-87b1-15f3e73c9dc0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:16.369357 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-8b8cc5b1-90bf-4402-87b1-15f3e73c9dc0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] HTTP exception thrown: Instance 3d2b6fc4-0338-4141-9ac3-7b579718fae9 could not be found. Aug 18 14:59:16.371564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8b8cc5b1-90bf-4402-87b1-15f3e73c9dc0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Request method failure captured: Aug 18 14:59:16.371564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 HTTP/1.1 Aug 18 14:59:16.371564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 14:59:16.371564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 14:59:16.371564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 14:59:16.371564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 14:59:16.371564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 14:59:16.371564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 14:59:16.371564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 14:59:16.371564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 14:59:16.371564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lH7zwFk8WrSTq6G01PM-9lXg9vxcQiJ2OXlNoO1fAQLssQJV-ZtF70LsGcxCBcKb3x3HtoOGVR9BN0TQGYehGA18R5A7qbUo3jtyF51HoVtsQj6so1ZYXbs3LvwW_nbOeN96fl4KGf_ya0nqGdS1LevxLlzbdB2w-QN91VI4eRRfs8 Aug 18 14:59:16.371564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 14:59:16.371564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 14:59:16.371564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 14:59:16.371564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 14:59:16.371564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 14:59:16.371564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 14:59:16.371564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 14:59:16.371564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: 594f04dadf2a45fcb5fe2a80744cb9e6 Aug 18 14:59:16.371564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-18518996 Aug 18 14:59:16.371564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 14:59:16.371564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 14:59:16.373036 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/594f04dadf2a45fcb5fe2a80744cb9e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/594f04dadf2a45fcb5fe2a80744cb9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_594f04dadf2a45fcb5fe2a80744cb9e6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/594f04dadf2a45fcb5fe2a80744cb9e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 14:59:16.373036 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-AttachVolumeShelveTestJSON-18518996 Aug 18 14:59:16.373036 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: 594f04dadf2a45fcb5fe2a80744cb9e6 Aug 18 14:59:16.373036 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-18518996 Aug 18 14:59:16.373036 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-AttachVolumeShelveTestJSON-18518996-project Aug 18 14:59:16.373036 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 14:59:16.373036 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 14:59:16.373036 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 09b055bb15ce4b2ab4276b0090e16122 Aug 18 14:59:16.373036 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-AttachVolumeShelveTestJSON-18518996-project Aug 18 14:59:16.373036 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 14:59:16.373036 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 3d2b6fc4-0338-4141-9ac3-7b579718fae9 could not be found. Aug 18 14:59:16.373036 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '3d2b6fc4-0338-4141-9ac3-7b579718fae9'} Aug 18 14:59:16.373779 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:59:16.373779 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:59:16.373779 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:59:16.373779 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:59:16.373779 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:59:16.373779 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:59:16.373779 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:59:16.373779 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:59:16.373779 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:59:16.373779 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:59:16.373779 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d2b6fc4-0338-4141-9ac3-7b579718fae9 could not be found. Aug 18 14:59:16.373779 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:16.373779 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:59:16.373779 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:16.373779 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:59:16.373779 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:59:16.373779 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:59:16.373779 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:59:16.373779 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:59:16.373779 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:59:16.375288 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:59:16.375288 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:59:16.375288 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:59:16.375288 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:59:16.375288 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:59:16.375288 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:59:16.375288 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:59:16.375288 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d2b6fc4-0338-4141-9ac3-7b579718fae9 could not be found. Aug 18 14:59:16.375288 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:16.375288 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:59:16.375288 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:16.375288 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:59:16.375288 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:59:16.375288 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:59:16.375288 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:59:16.375288 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:59:16.375288 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d2b6fc4-0338-4141-9ac3-7b579718fae9 could not be found. Aug 18 14:59:16.375288 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 14:59:16.376420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8b8cc5b1-90bf-4402-87b1-15f3e73c9dc0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] Returning 404 to user: Instance 3d2b6fc4-0338-4141-9ac3-7b579718fae9 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:59:16.376420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-8b8cc5b1-90bf-4402-87b1-15f3e73c9dc0 tempest-AttachVolumeShelveTestJSON-18518996 tempest-AttachVolumeShelveTestJSON-18518996-project] 10.222.0.36 "GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9" status: 404 len: 111 microversion: 2.20 time: 0.036703 Aug 18 14:59:16.376420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 733/995] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Aug 18 14:59:16 2022] GET /compute/v2.1/servers/3d2b6fc4-0338-4141-9ac3-7b579718fae9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 14:59:43.880936 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-891b1817-827d-4255-b954-567d1db0aa25 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1966991666", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-198073082", "security_groups": [{"name": "tempest-secgroup-smoke-456689280"}], "block_device_mapping_v2": [{"uuid": "6d60c2c1-d273-40c0-b349-7b3f193c04e9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "24aebd51-9a3b-4fcd-801c-0a194132131f"}]}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:59:43.892012 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:59:43.892669 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=52,nova_cell1:INSERT=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:59:44.012144 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.network.neutron [None req-891b1817-827d-4255-b954-567d1db0aa25 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] validate_networks() for [('24aebd51-9a3b-4fcd-801c-0a194132131f', None, None, None, None, None)] {{(pid=132268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:59:44.403924 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-891b1817-827d-4255-b954-567d1db0aa25 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Flavor limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:59:44.404381 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-891b1817-827d-4255-b954-567d1db0aa25 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Image limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:59:44.404861 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-891b1817-827d-4255-b954-567d1db0aa25 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Flavor pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:59:44.405272 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-891b1817-827d-4255-b954-567d1db0aa25 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Image pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:59:44.405688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-891b1817-827d-4255-b954-567d1db0aa25 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:59:44.420623 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-891b1817-827d-4255-b954-567d1db0aa25 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:44.421107 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-891b1817-827d-4255-b954-567d1db0aa25 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:44.421543 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-891b1817-827d-4255-b954-567d1db0aa25 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:44.422443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-891b1817-827d-4255-b954-567d1db0aa25 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:44.422982 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-891b1817-827d-4255-b954-567d1db0aa25 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:44.423461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-891b1817-827d-4255-b954-567d1db0aa25 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:44.446731 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-891b1817-827d-4255-b954-567d1db0aa25 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Getting quotas for project d334ad6bd6194604a61ce4ca95149993. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:59:44.451388 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-891b1817-827d-4255-b954-567d1db0aa25 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Getting quotas for user ac4d918f549c41d3ae19e80cecefa95c and project d334ad6bd6194604a61ce4ca95149993. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:59:44.516587 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-891b1817-827d-4255-b954-567d1db0aa25 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Going to run 1 instances... {{(pid=132268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:59:44.518743 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-891b1817-827d-4255-b954-567d1db0aa25 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 5f2d59d8-2292-4b8d-81f1-5b7d347a1268] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6d60c2c1-d273-40c0-b349-7b3f193c04e9',volume_size=None,volume_type=None)] {{(pid=132268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:59:44.695749 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-891b1817-827d-4255-b954-567d1db0aa25 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.819044 Aug 18 14:59:44.700077 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 734/996] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Aug 18 14:59:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 14:59:44.708988 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-59d8d3ea-6d24-4908-a0d2-81c87c780923 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:44.709616 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-59d8d3ea-6d24-4908-a0d2-81c87c780923 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 5f2d59d8-2292-4b8d-81f1-5b7d347a1268] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:44.776352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-59d8d3ea-6d24-4908-a0d2-81c87c780923 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:44.783413 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-59d8d3ea-6d24-4908-a0d2-81c87c780923 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268" status: 200 len: 1094 microversion: 2.1 time: 0.079735 Aug 18 14:59:44.784140 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 735/997] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:59:44 2022] GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268 => generated 1094 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:59:45.807846 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-70ead1f1-9be5-4813-986f-558adc5d352a tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:45.809268 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-70ead1f1-9be5-4813-986f-558adc5d352a tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 5f2d59d8-2292-4b8d-81f1-5b7d347a1268] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:45.835671 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-70ead1f1-9be5-4813-986f-558adc5d352a tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:45.836596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-70ead1f1-9be5-4813-986f-558adc5d352a tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:45.837260 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-70ead1f1-9be5-4813-986f-558adc5d352a tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:45.838186 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-70ead1f1-9be5-4813-986f-558adc5d352a tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:45.845217 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-70ead1f1-9be5-4813-986f-558adc5d352a tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:45.845973 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-70ead1f1-9be5-4813-986f-558adc5d352a tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:45.959120 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-70ead1f1-9be5-4813-986f-558adc5d352a tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:45.968547 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-70ead1f1-9be5-4813-986f-558adc5d352a tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268" status: 200 len: 1200 microversion: 2.1 time: 0.167383 Aug 18 14:59:45.979357 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 736/998] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:59:45 2022] GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268 => generated 1200 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:59:46.994864 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-fe1404b4-889d-4e3b-9ea8-243e6eed57a4 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:46.995645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-fe1404b4-889d-4e3b-9ea8-243e6eed57a4 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 5f2d59d8-2292-4b8d-81f1-5b7d347a1268] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:47.002663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fe1404b4-889d-4e3b-9ea8-243e6eed57a4 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:47.004084 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fe1404b4-889d-4e3b-9ea8-243e6eed57a4 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:47.004700 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fe1404b4-889d-4e3b-9ea8-243e6eed57a4 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:47.005625 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fe1404b4-889d-4e3b-9ea8-243e6eed57a4 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:47.006826 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fe1404b4-889d-4e3b-9ea8-243e6eed57a4 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:47.008097 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-fe1404b4-889d-4e3b-9ea8-243e6eed57a4 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:47.304824 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-fe1404b4-889d-4e3b-9ea8-243e6eed57a4 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:47.314252 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-fe1404b4-889d-4e3b-9ea8-243e6eed57a4 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268" status: 200 len: 1277 microversion: 2.1 time: 0.324232 Aug 18 14:59:47.327974 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 737/999] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:59:46 2022] GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268 => generated 1277 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:59:48.337430 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d4eabcad-e26a-491e-8c5f-1932179566dd tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:48.338092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d4eabcad-e26a-491e-8c5f-1932179566dd tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 5f2d59d8-2292-4b8d-81f1-5b7d347a1268] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:48.354031 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d4eabcad-e26a-491e-8c5f-1932179566dd tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:48.354745 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d4eabcad-e26a-491e-8c5f-1932179566dd tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:48.358052 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d4eabcad-e26a-491e-8c5f-1932179566dd tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:48.358806 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d4eabcad-e26a-491e-8c5f-1932179566dd tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:48.359272 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d4eabcad-e26a-491e-8c5f-1932179566dd tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:48.359730 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d4eabcad-e26a-491e-8c5f-1932179566dd tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:48.554083 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d4eabcad-e26a-491e-8c5f-1932179566dd tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:48.562159 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d4eabcad-e26a-491e-8c5f-1932179566dd tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268" status: 200 len: 1277 microversion: 2.1 time: 0.230129 Aug 18 14:59:48.563379 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 738/1000] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:59:48 2022] GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268 => generated 1277 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:59:49.590319 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c0c4d097-85b8-438c-8395-ba85058219fc tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:49.591663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c0c4d097-85b8-438c-8395-ba85058219fc tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 5f2d59d8-2292-4b8d-81f1-5b7d347a1268] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:49.599742 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c0c4d097-85b8-438c-8395-ba85058219fc tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:49.600482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c0c4d097-85b8-438c-8395-ba85058219fc tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:49.601102 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c0c4d097-85b8-438c-8395-ba85058219fc tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:49.602019 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c0c4d097-85b8-438c-8395-ba85058219fc tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:49.602637 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c0c4d097-85b8-438c-8395-ba85058219fc tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:49.603213 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c0c4d097-85b8-438c-8395-ba85058219fc tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:49.777773 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c0c4d097-85b8-438c-8395-ba85058219fc tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:49.813146 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c0c4d097-85b8-438c-8395-ba85058219fc tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268" status: 200 len: 1277 microversion: 2.1 time: 0.233635 Aug 18 14:59:49.825345 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 739/1001] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:59:49 2022] GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268 => generated 1277 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:59:50.617825 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-aa44139e-4dfd-44bb-b055-f47b0d3748a6 req-abdb34db-8954-4845-8d7d-84d4426694fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f2d59d8-2292-4b8d-81f1-5b7d347a1268", "tag": "5902a59f-c00d-4868-b91b-03d7c9ac623f"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:59:50.646725 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-aa44139e-4dfd-44bb-b055-f47b0d3748a6 req-abdb34db-8954-4845-8d7d-84d4426694fe service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:50.664355 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-aa44139e-4dfd-44bb-b055-f47b0d3748a6 req-abdb34db-8954-4845-8d7d-84d4426694fe service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:50.664838 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-aa44139e-4dfd-44bb-b055-f47b0d3748a6 req-abdb34db-8954-4845-8d7d-84d4426694fe service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:50.680022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-aa44139e-4dfd-44bb-b055-f47b0d3748a6 req-abdb34db-8954-4845-8d7d-84d4426694fe service nova] Creating event network-changed:5902a59f-c00d-4868-b91b-03d7c9ac623f for instance 5f2d59d8-2292-4b8d-81f1-5b7d347a1268 on hv-cinder-85220 Aug 18 14:59:50.688739 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-aa44139e-4dfd-44bb-b055-f47b0d3748a6 req-abdb34db-8954-4845-8d7d-84d4426694fe service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077245 Aug 18 14:59:50.689977 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 740/1002] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 14:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:59:50.840481 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-43011f11-f5d6-414b-a912-66c5303d88ad tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:50.841330 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-43011f11-f5d6-414b-a912-66c5303d88ad tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 5f2d59d8-2292-4b8d-81f1-5b7d347a1268] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:50.848362 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-43011f11-f5d6-414b-a912-66c5303d88ad tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:50.848972 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-43011f11-f5d6-414b-a912-66c5303d88ad tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:50.849590 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-43011f11-f5d6-414b-a912-66c5303d88ad tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:50.850452 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-43011f11-f5d6-414b-a912-66c5303d88ad tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:50.851074 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-43011f11-f5d6-414b-a912-66c5303d88ad tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:50.851793 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-43011f11-f5d6-414b-a912-66c5303d88ad tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:51.022914 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-43011f11-f5d6-414b-a912-66c5303d88ad tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:51.032522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-43011f11-f5d6-414b-a912-66c5303d88ad tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268" status: 200 len: 1265 microversion: 2.1 time: 0.199685 Aug 18 14:59:51.033733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 741/1003] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:59:50 2022] GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:59:52.055133 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0d0562f8-9fd4-4d3d-8d64-d6fcd19b1499 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:52.056914 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0d0562f8-9fd4-4d3d-8d64-d6fcd19b1499 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 5f2d59d8-2292-4b8d-81f1-5b7d347a1268] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:52.063602 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0d0562f8-9fd4-4d3d-8d64-d6fcd19b1499 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:52.064350 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0d0562f8-9fd4-4d3d-8d64-d6fcd19b1499 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:52.064955 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0d0562f8-9fd4-4d3d-8d64-d6fcd19b1499 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:52.065984 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0d0562f8-9fd4-4d3d-8d64-d6fcd19b1499 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:52.066905 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0d0562f8-9fd4-4d3d-8d64-d6fcd19b1499 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:52.067701 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0d0562f8-9fd4-4d3d-8d64-d6fcd19b1499 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:52.394470 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-0d0562f8-9fd4-4d3d-8d64-d6fcd19b1499 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:52.404088 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0d0562f8-9fd4-4d3d-8d64-d6fcd19b1499 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268" status: 200 len: 1265 microversion: 2.1 time: 0.353458 Aug 18 14:59:52.418846 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 742/1004] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:59:52 2022] GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268 => generated 1265 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:59:53.429997 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-6c30dc92-7c5c-4ce5-bacb-6ceaec3c7d3f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:53.437661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-6c30dc92-7c5c-4ce5-bacb-6ceaec3c7d3f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 5f2d59d8-2292-4b8d-81f1-5b7d347a1268] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:53.455140 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6c30dc92-7c5c-4ce5-bacb-6ceaec3c7d3f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:53.455977 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6c30dc92-7c5c-4ce5-bacb-6ceaec3c7d3f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:53.456565 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6c30dc92-7c5c-4ce5-bacb-6ceaec3c7d3f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:53.457914 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6c30dc92-7c5c-4ce5-bacb-6ceaec3c7d3f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:53.458532 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6c30dc92-7c5c-4ce5-bacb-6ceaec3c7d3f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:53.459114 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6c30dc92-7c5c-4ce5-bacb-6ceaec3c7d3f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:54.169685 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6c30dc92-7c5c-4ce5-bacb-6ceaec3c7d3f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:54.184571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-6c30dc92-7c5c-4ce5-bacb-6ceaec3c7d3f tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268" status: 200 len: 1265 microversion: 2.1 time: 0.762251 Aug 18 14:59:54.185516 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 743/1005] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:59:53 2022] GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268 => generated 1265 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:59:55.206926 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-6bd1da8d-db28-4755-9d7a-e3bb1e4527b1 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:55.207760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-6bd1da8d-db28-4755-9d7a-e3bb1e4527b1 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 5f2d59d8-2292-4b8d-81f1-5b7d347a1268] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:55.216570 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=2 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:59:55.220631 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=8 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:59:55.228915 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6bd1da8d-db28-4755-9d7a-e3bb1e4527b1 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:55.229439 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6bd1da8d-db28-4755-9d7a-e3bb1e4527b1 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:55.229888 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6bd1da8d-db28-4755-9d7a-e3bb1e4527b1 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:55.230628 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6bd1da8d-db28-4755-9d7a-e3bb1e4527b1 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:55.231094 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6bd1da8d-db28-4755-9d7a-e3bb1e4527b1 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:55.238056 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6bd1da8d-db28-4755-9d7a-e3bb1e4527b1 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:55.812672 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6bd1da8d-db28-4755-9d7a-e3bb1e4527b1 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:55.821653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-6bd1da8d-db28-4755-9d7a-e3bb1e4527b1 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268" status: 200 len: 1265 microversion: 2.1 time: 0.618975 Aug 18 14:59:55.845849 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 744/1006] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:59:55 2022] GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268 => generated 1265 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:59:56.847074 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-02facd04-783f-478c-bb03-8a019a55eecf tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:56.849008 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-02facd04-783f-478c-bb03-8a019a55eecf tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 5f2d59d8-2292-4b8d-81f1-5b7d347a1268] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:56.869495 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-02facd04-783f-478c-bb03-8a019a55eecf tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:56.869998 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-02facd04-783f-478c-bb03-8a019a55eecf tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:56.870444 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-02facd04-783f-478c-bb03-8a019a55eecf tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:56.873231 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-02facd04-783f-478c-bb03-8a019a55eecf tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:56.874617 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-02facd04-783f-478c-bb03-8a019a55eecf tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:56.875067 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-02facd04-783f-478c-bb03-8a019a55eecf tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:57.283445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-02facd04-783f-478c-bb03-8a019a55eecf tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:57.299850 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-02facd04-783f-478c-bb03-8a019a55eecf tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268" status: 200 len: 1265 microversion: 2.1 time: 0.453725 Aug 18 14:59:57.311769 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 745/1007] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:59:56 2022] GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268 => generated 1265 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:59:58.499728 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-765ce3c2-610c-4f21-8ff3-c475a59477d5 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Action: 'create', calling method: .version_select at 0x7fb20efcfc10>, body: {"keypair": {"name": "tempest-TestShelveInstance-797180520", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnInO3cYomy0J6e3GX/nrxwaInoSfmIbCBMFqixdLK6iGzHkNkRSPZAivPsIu3WHa+bB07ph78dY9axD4TZ87zwaO0f2AkAS6wRgg+UN7rAXI2a6JZLsnnxIWwlkA8QGg=="}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:59:58.517506 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-765ce3c2-610c-4f21-8ff3-c475a59477d5 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Getting quotas for project 379b08d3cf834ca9b891abd6ba0f14ee. Resources: {'key_pairs'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:59:58.521742 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-765ce3c2-610c-4f21-8ff3-c475a59477d5 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Getting quotas for user 1e3a4f725f3d41edbb7c162a8760bf8b and project 379b08d3cf834ca9b891abd6ba0f14ee. Resources: {'key_pairs'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:59:58.551934 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-765ce3c2-610c-4f21-8ff3-c475a59477d5 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.338799 Aug 18 14:59:58.552641 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 746/1008] 10.222.0.36 () {60 vars in 1159 bytes} [Thu Aug 18 14:59:58 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:59:58.558568 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-580c09ba-b90e-40b5-8812-04ed35301208 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:58.573117 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-580c09ba-b90e-40b5-8812-04ed35301208 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 5f2d59d8-2292-4b8d-81f1-5b7d347a1268] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:58.583344 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-580c09ba-b90e-40b5-8812-04ed35301208 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:58.584305 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-580c09ba-b90e-40b5-8812-04ed35301208 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:58.584831 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-580c09ba-b90e-40b5-8812-04ed35301208 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:58.585563 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-580c09ba-b90e-40b5-8812-04ed35301208 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:58.586051 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-580c09ba-b90e-40b5-8812-04ed35301208 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:58.586345 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-580c09ba-b90e-40b5-8812-04ed35301208 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:58.824546 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-580c09ba-b90e-40b5-8812-04ed35301208 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:59:58.838222 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-580c09ba-b90e-40b5-8812-04ed35301208 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268" status: 200 len: 1265 microversion: 2.1 time: 0.284181 Aug 18 14:59:58.863630 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 747/1009] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:59:58 2022] GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268 => generated 1265 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:59:59.868052 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-4a460bbd-6914-4080-bb25-79f819e4e970 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:59:59.869742 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-4a460bbd-6914-4080-bb25-79f819e4e970 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 5f2d59d8-2292-4b8d-81f1-5b7d347a1268] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:59:59.883448 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4a460bbd-6914-4080-bb25-79f819e4e970 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:59.884153 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4a460bbd-6914-4080-bb25-79f819e4e970 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:59.884788 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4a460bbd-6914-4080-bb25-79f819e4e970 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:59:59.885672 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4a460bbd-6914-4080-bb25-79f819e4e970 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:59:59.886298 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4a460bbd-6914-4080-bb25-79f819e4e970 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:59:59.887238 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4a460bbd-6914-4080-bb25-79f819e4e970 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:00.077322 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-4a460bbd-6914-4080-bb25-79f819e4e970 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:00:00.089076 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-4a460bbd-6914-4080-bb25-79f819e4e970 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268" status: 200 len: 1265 microversion: 2.1 time: 0.227035 Aug 18 15:00:00.097694 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 748/1010] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 14:59:59 2022] GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 15:00:01.110717 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d73cc67b-2e71-42fa-ac20-96f4f8c02cea tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:00:01.111405 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d73cc67b-2e71-42fa-ac20-96f4f8c02cea tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 5f2d59d8-2292-4b8d-81f1-5b7d347a1268] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:00:01.117843 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d73cc67b-2e71-42fa-ac20-96f4f8c02cea tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:01.118332 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d73cc67b-2e71-42fa-ac20-96f4f8c02cea tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:01.118768 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d73cc67b-2e71-42fa-ac20-96f4f8c02cea tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:01.119473 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d73cc67b-2e71-42fa-ac20-96f4f8c02cea tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:01.119946 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d73cc67b-2e71-42fa-ac20-96f4f8c02cea tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:01.120370 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d73cc67b-2e71-42fa-ac20-96f4f8c02cea tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:01.277305 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d73cc67b-2e71-42fa-ac20-96f4f8c02cea tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:00:01.286893 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d73cc67b-2e71-42fa-ac20-96f4f8c02cea tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268" status: 200 len: 1265 microversion: 2.1 time: 0.180127 Aug 18 15:00:01.288889 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 749/1011] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:00:01 2022] GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:00:01.676762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-8628e07b-ccdd-46af-bf81-527062025c1b req-84a9f43f-5429-4720-a554-ee376309ebb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f2d59d8-2292-4b8d-81f1-5b7d347a1268", "name": "network-vif-plugged", "status": "completed", "tag": "5902a59f-c00d-4868-b91b-03d7c9ac623f"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:00:01.690559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-8628e07b-ccdd-46af-bf81-527062025c1b req-84a9f43f-5429-4720-a554-ee376309ebb0 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:01.691239 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-8628e07b-ccdd-46af-bf81-527062025c1b req-84a9f43f-5429-4720-a554-ee376309ebb0 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:01.691941 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-8628e07b-ccdd-46af-bf81-527062025c1b req-84a9f43f-5429-4720-a554-ee376309ebb0 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:01.719550 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-8628e07b-ccdd-46af-bf81-527062025c1b req-84a9f43f-5429-4720-a554-ee376309ebb0 service nova] Creating event network-vif-plugged:5902a59f-c00d-4868-b91b-03d7c9ac623f for instance 5f2d59d8-2292-4b8d-81f1-5b7d347a1268 on hv-cinder-85220 Aug 18 15:00:01.728965 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-8628e07b-ccdd-46af-bf81-527062025c1b req-84a9f43f-5429-4720-a554-ee376309ebb0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056523 Aug 18 15:00:01.729872 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 750/1012] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 15:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 15:00:02.311394 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c5748bf2-f92c-4ea1-8e9c-ae8d4bb50fee tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:00:02.312282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c5748bf2-f92c-4ea1-8e9c-ae8d4bb50fee tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 5f2d59d8-2292-4b8d-81f1-5b7d347a1268] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:00:02.318877 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c5748bf2-f92c-4ea1-8e9c-ae8d4bb50fee tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:02.320611 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c5748bf2-f92c-4ea1-8e9c-ae8d4bb50fee tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:02.321338 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c5748bf2-f92c-4ea1-8e9c-ae8d4bb50fee tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:02.322074 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c5748bf2-f92c-4ea1-8e9c-ae8d4bb50fee tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:02.322533 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c5748bf2-f92c-4ea1-8e9c-ae8d4bb50fee tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:02.322967 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c5748bf2-f92c-4ea1-8e9c-ae8d4bb50fee tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:02.471433 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c5748bf2-f92c-4ea1-8e9c-ae8d4bb50fee tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:00:02.480003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c5748bf2-f92c-4ea1-8e9c-ae8d4bb50fee tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268" status: 200 len: 1265 microversion: 2.1 time: 0.173586 Aug 18 15:00:02.480585 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 751/1013] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:00:02 2022] GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:00:03.502514 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ecf96e4b-cd2c-441a-93b3-3dc04e389de6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:00:03.503216 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ecf96e4b-cd2c-441a-93b3-3dc04e389de6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 5f2d59d8-2292-4b8d-81f1-5b7d347a1268] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:00:03.510341 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ecf96e4b-cd2c-441a-93b3-3dc04e389de6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:03.510843 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ecf96e4b-cd2c-441a-93b3-3dc04e389de6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:03.511277 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ecf96e4b-cd2c-441a-93b3-3dc04e389de6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:03.512000 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ecf96e4b-cd2c-441a-93b3-3dc04e389de6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:03.512456 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ecf96e4b-cd2c-441a-93b3-3dc04e389de6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:03.512907 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ecf96e4b-cd2c-441a-93b3-3dc04e389de6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:03.654075 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ecf96e4b-cd2c-441a-93b3-3dc04e389de6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:00:03.662615 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-ecf96e4b-cd2c-441a-93b3-3dc04e389de6 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268" status: 200 len: 1265 microversion: 2.1 time: 0.163959 Aug 18 15:00:03.663273 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 752/1014] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:00:03 2022] GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:00:04.685064 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-551a2277-4d78-43e5-82cd-b010ec366128 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:00:04.686851 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-551a2277-4d78-43e5-82cd-b010ec366128 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 5f2d59d8-2292-4b8d-81f1-5b7d347a1268] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:00:04.695274 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-551a2277-4d78-43e5-82cd-b010ec366128 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:04.695917 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-551a2277-4d78-43e5-82cd-b010ec366128 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:04.696600 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-551a2277-4d78-43e5-82cd-b010ec366128 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:04.697321 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-551a2277-4d78-43e5-82cd-b010ec366128 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:04.697808 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-551a2277-4d78-43e5-82cd-b010ec366128 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:04.698234 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-551a2277-4d78-43e5-82cd-b010ec366128 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:04.846896 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-551a2277-4d78-43e5-82cd-b010ec366128 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:00:04.854842 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-551a2277-4d78-43e5-82cd-b010ec366128 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268" status: 200 len: 1451 microversion: 2.1 time: 0.174445 Aug 18 15:00:04.855406 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 753/1015] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:00:04 2022] GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268 => generated 1451 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 15:00:04.876796 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-481f0f56-ab45-4c6e-82e6-6f2ee0971496 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:00:04.877717 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-481f0f56-ab45-4c6e-82e6-6f2ee0971496 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 5f2d59d8-2292-4b8d-81f1-5b7d347a1268] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:00:04.884587 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-481f0f56-ab45-4c6e-82e6-6f2ee0971496 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:04.885140 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-481f0f56-ab45-4c6e-82e6-6f2ee0971496 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:04.885646 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-481f0f56-ab45-4c6e-82e6-6f2ee0971496 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:04.886484 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-481f0f56-ab45-4c6e-82e6-6f2ee0971496 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:04.887492 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-481f0f56-ab45-4c6e-82e6-6f2ee0971496 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:04.888012 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-481f0f56-ab45-4c6e-82e6-6f2ee0971496 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:04.909452 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=100 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 15:00:05.037126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-481f0f56-ab45-4c6e-82e6-6f2ee0971496 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:00:05.045779 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-481f0f56-ab45-4c6e-82e6-6f2ee0971496 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268" status: 200 len: 1451 microversion: 2.1 time: 0.174072 Aug 18 15:00:05.046443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 754/1016] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:00:04 2022] GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268 => generated 1451 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:00:07.242039 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-46ec1b58-3c12-4fda-ba70-cf9a9233eaff req-73bdf182-0cc6-46dc-94e1-bf4303a71800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f2d59d8-2292-4b8d-81f1-5b7d347a1268", "tag": "5902a59f-c00d-4868-b91b-03d7c9ac623f"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:00:07.253608 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-46ec1b58-3c12-4fda-ba70-cf9a9233eaff req-73bdf182-0cc6-46dc-94e1-bf4303a71800 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:07.254157 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-46ec1b58-3c12-4fda-ba70-cf9a9233eaff req-73bdf182-0cc6-46dc-94e1-bf4303a71800 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:07.254653 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-46ec1b58-3c12-4fda-ba70-cf9a9233eaff req-73bdf182-0cc6-46dc-94e1-bf4303a71800 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:07.269350 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-46ec1b58-3c12-4fda-ba70-cf9a9233eaff req-73bdf182-0cc6-46dc-94e1-bf4303a71800 service nova] Creating event network-changed:5902a59f-c00d-4868-b91b-03d7c9ac623f for instance 5f2d59d8-2292-4b8d-81f1-5b7d347a1268 on hv-cinder-85220 Aug 18 15:00:07.275168 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-46ec1b58-3c12-4fda-ba70-cf9a9233eaff req-73bdf182-0cc6-46dc-94e1-bf4303a71800 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037444 Aug 18 15:00:07.276220 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 755/1017] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 15:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 15:00:17.422856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=4 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 15:00:17.423946 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 15:00:17.424740 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=4 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 15:00:17.430193 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ab242d1e-70be-49b8-96d3-e339d0819525 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-751269827", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-797180520", "security_groups": [{"name": "tempest-secgroup-smoke-367977462"}], "networks": [{"uuid": "e09eba84-df41-4a14-b1da-b18c523e1acb"}], "block_device_mapping_v2": [{"uuid": "943713bb-dbeb-490d-a389-c32fe489b574", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:00:17.551536 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.network.neutron [None req-ab242d1e-70be-49b8-96d3-e339d0819525 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] validate_networks() for [('e09eba84-df41-4a14-b1da-b18c523e1acb', None, None, None, None, None)] {{(pid=132268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 15:00:17.939544 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-ab242d1e-70be-49b8-96d3-e339d0819525 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Flavor limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 15:00:17.940009 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-ab242d1e-70be-49b8-96d3-e339d0819525 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Image limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 15:00:17.940486 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-ab242d1e-70be-49b8-96d3-e339d0819525 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Flavor pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 15:00:17.940894 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-ab242d1e-70be-49b8-96d3-e339d0819525 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Image pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 15:00:17.941305 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-ab242d1e-70be-49b8-96d3-e339d0819525 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 15:00:17.951014 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ab242d1e-70be-49b8-96d3-e339d0819525 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:17.951605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ab242d1e-70be-49b8-96d3-e339d0819525 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:17.953065 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ab242d1e-70be-49b8-96d3-e339d0819525 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:17.954265 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ab242d1e-70be-49b8-96d3-e339d0819525 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:17.954757 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ab242d1e-70be-49b8-96d3-e339d0819525 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:17.955215 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ab242d1e-70be-49b8-96d3-e339d0819525 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:17.973644 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-ab242d1e-70be-49b8-96d3-e339d0819525 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Getting quotas for project 379b08d3cf834ca9b891abd6ba0f14ee. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 15:00:17.978111 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-ab242d1e-70be-49b8-96d3-e339d0819525 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Getting quotas for user 1e3a4f725f3d41edbb7c162a8760bf8b and project 379b08d3cf834ca9b891abd6ba0f14ee. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 15:00:18.036860 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ab242d1e-70be-49b8-96d3-e339d0819525 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Going to run 1 instances... {{(pid=132268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 15:00:18.039747 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ab242d1e-70be-49b8-96d3-e339d0819525 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='943713bb-dbeb-490d-a389-c32fe489b574',volume_size=None,volume_type=None)] {{(pid=132268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 15:00:18.176445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-ab242d1e-70be-49b8-96d3-e339d0819525 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.754891 Aug 18 15:00:18.177192 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 756/1018] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Aug 18 15:00:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 15:00:18.188173 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2823e022-6911-49cc-ba53-f2c828389fec tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:00:18.188786 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2823e022-6911-49cc-ba53-f2c828389fec tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:00:18.245186 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2823e022-6911-49cc-ba53-f2c828389fec tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:00:18.252188 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2823e022-6911-49cc-ba53-f2c828389fec tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1087 microversion: 2.1 time: 0.067811 Aug 18 15:00:18.252998 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 757/1019] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:00:18 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1087 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:00:19.273105 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5e304243-752e-4fa2-8d31-86403c2ce928 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:00:19.273883 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-5e304243-752e-4fa2-8d31-86403c2ce928 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:00:19.281299 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5e304243-752e-4fa2-8d31-86403c2ce928 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:19.281791 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5e304243-752e-4fa2-8d31-86403c2ce928 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:19.282396 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5e304243-752e-4fa2-8d31-86403c2ce928 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:19.283092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5e304243-752e-4fa2-8d31-86403c2ce928 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:19.283543 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5e304243-752e-4fa2-8d31-86403c2ce928 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:19.283981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5e304243-752e-4fa2-8d31-86403c2ce928 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:19.351192 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-5e304243-752e-4fa2-8d31-86403c2ce928 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:00:19.359836 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-5e304243-752e-4fa2-8d31-86403c2ce928 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1193 microversion: 2.1 time: 0.090964 Aug 18 15:00:19.360470 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 758/1020] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:00:19 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1193 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:00:20.381061 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-69f068b7-cd80-4144-a717-c342e79f9a8d tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:00:20.381707 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-69f068b7-cd80-4144-a717-c342e79f9a8d tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:00:20.388188 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-69f068b7-cd80-4144-a717-c342e79f9a8d tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:20.388673 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-69f068b7-cd80-4144-a717-c342e79f9a8d tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:20.389105 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-69f068b7-cd80-4144-a717-c342e79f9a8d tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:20.389796 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-69f068b7-cd80-4144-a717-c342e79f9a8d tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:20.390510 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-69f068b7-cd80-4144-a717-c342e79f9a8d tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:20.390931 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-69f068b7-cd80-4144-a717-c342e79f9a8d tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:20.558928 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-69f068b7-cd80-4144-a717-c342e79f9a8d tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:00:20.567377 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-69f068b7-cd80-4144-a717-c342e79f9a8d tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1258 microversion: 2.1 time: 0.190125 Aug 18 15:00:20.568263 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 759/1021] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:00:20 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1258 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:00:20.725687 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-3bbf771f-15b1-479f-98cf-9707959766a5 req-7e29aeba-e177-47d7-908c-e6c68c846a6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40cbcd5e-57d5-4177-8358-32279c6770d6", "tag": "ba5c5ae4-144d-49b9-9e54-5dacaef83b8d"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:00:20.736752 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-3bbf771f-15b1-479f-98cf-9707959766a5 req-7e29aeba-e177-47d7-908c-e6c68c846a6e service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:20.737757 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-3bbf771f-15b1-479f-98cf-9707959766a5 req-7e29aeba-e177-47d7-908c-e6c68c846a6e service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:20.738460 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-3bbf771f-15b1-479f-98cf-9707959766a5 req-7e29aeba-e177-47d7-908c-e6c68c846a6e service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:20.751156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-3bbf771f-15b1-479f-98cf-9707959766a5 req-7e29aeba-e177-47d7-908c-e6c68c846a6e service nova] Creating event network-changed:ba5c5ae4-144d-49b9-9e54-5dacaef83b8d for instance 40cbcd5e-57d5-4177-8358-32279c6770d6 on hv-cinder-85220 Aug 18 15:00:20.756236 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-3bbf771f-15b1-479f-98cf-9707959766a5 req-7e29aeba-e177-47d7-908c-e6c68c846a6e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035282 Aug 18 15:00:20.757503 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 760/1022] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 15:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 15:00:21.590640 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-9833fe4c-7ccc-4e62-8752-21e985cf6a6e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:00:21.591633 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-9833fe4c-7ccc-4e62-8752-21e985cf6a6e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:00:21.598279 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9833fe4c-7ccc-4e62-8752-21e985cf6a6e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:21.598757 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9833fe4c-7ccc-4e62-8752-21e985cf6a6e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:21.599369 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9833fe4c-7ccc-4e62-8752-21e985cf6a6e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:21.600769 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9833fe4c-7ccc-4e62-8752-21e985cf6a6e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:21.601300 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9833fe4c-7ccc-4e62-8752-21e985cf6a6e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:21.601724 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9833fe4c-7ccc-4e62-8752-21e985cf6a6e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:21.745779 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-9833fe4c-7ccc-4e62-8752-21e985cf6a6e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:00:21.753547 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-9833fe4c-7ccc-4e62-8752-21e985cf6a6e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1258 microversion: 2.1 time: 0.167146 Aug 18 15:00:21.754124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 761/1023] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:00:21 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:00:22.773904 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-9343601e-cf95-4e8e-b6a9-c0fe24ac7221 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:00:22.774515 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-9343601e-cf95-4e8e-b6a9-c0fe24ac7221 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:00:22.780915 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9343601e-cf95-4e8e-b6a9-c0fe24ac7221 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:22.781390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9343601e-cf95-4e8e-b6a9-c0fe24ac7221 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:22.781813 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9343601e-cf95-4e8e-b6a9-c0fe24ac7221 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:22.782489 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9343601e-cf95-4e8e-b6a9-c0fe24ac7221 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:22.782932 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9343601e-cf95-4e8e-b6a9-c0fe24ac7221 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:22.783344 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9343601e-cf95-4e8e-b6a9-c0fe24ac7221 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:22.919004 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-9343601e-cf95-4e8e-b6a9-c0fe24ac7221 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:00:22.928001 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-9343601e-cf95-4e8e-b6a9-c0fe24ac7221 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1258 microversion: 2.1 time: 0.157843 Aug 18 15:00:22.929365 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 762/1024] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:00:22 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:00:23.950329 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-9b054db2-d715-43a5-b122-fafb5585559e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:00:23.950983 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-9b054db2-d715-43a5-b122-fafb5585559e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:00:23.957426 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9b054db2-d715-43a5-b122-fafb5585559e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:23.957907 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9b054db2-d715-43a5-b122-fafb5585559e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:23.958339 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9b054db2-d715-43a5-b122-fafb5585559e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:23.959021 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9b054db2-d715-43a5-b122-fafb5585559e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:23.960120 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9b054db2-d715-43a5-b122-fafb5585559e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:23.960551 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9b054db2-d715-43a5-b122-fafb5585559e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:24.091349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-9b054db2-d715-43a5-b122-fafb5585559e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:00:24.099165 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-9b054db2-d715-43a5-b122-fafb5585559e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1258 microversion: 2.1 time: 0.152732 Aug 18 15:00:24.099746 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 763/1025] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:00:23 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:00:25.120136 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e04aca95-732c-4859-a311-61f8cebc82fc tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:00:25.120809 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e04aca95-732c-4859-a311-61f8cebc82fc tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:00:25.126972 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e04aca95-732c-4859-a311-61f8cebc82fc tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:25.127441 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e04aca95-732c-4859-a311-61f8cebc82fc tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:25.127904 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e04aca95-732c-4859-a311-61f8cebc82fc tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:25.128587 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e04aca95-732c-4859-a311-61f8cebc82fc tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:25.129033 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e04aca95-732c-4859-a311-61f8cebc82fc tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:25.129447 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e04aca95-732c-4859-a311-61f8cebc82fc tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:25.265872 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e04aca95-732c-4859-a311-61f8cebc82fc tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:00:25.273409 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e04aca95-732c-4859-a311-61f8cebc82fc tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1258 microversion: 2.1 time: 0.157739 Aug 18 15:00:25.273968 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 764/1026] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:00:25 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:00:26.293876 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c142936b-3600-4c82-a04e-dc6a52b075be tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:00:26.294486 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c142936b-3600-4c82-a04e-dc6a52b075be tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:00:26.300875 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c142936b-3600-4c82-a04e-dc6a52b075be tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:26.301350 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c142936b-3600-4c82-a04e-dc6a52b075be tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:26.301775 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c142936b-3600-4c82-a04e-dc6a52b075be tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:26.302451 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c142936b-3600-4c82-a04e-dc6a52b075be tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:26.302892 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c142936b-3600-4c82-a04e-dc6a52b075be tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:26.303307 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c142936b-3600-4c82-a04e-dc6a52b075be tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:26.434239 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c142936b-3600-4c82-a04e-dc6a52b075be tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:00:26.442177 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c142936b-3600-4c82-a04e-dc6a52b075be tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1258 microversion: 2.1 time: 0.152168 Aug 18 15:00:26.442758 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 765/1027] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:00:26 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:00:27.463858 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0ab0c18e-36bd-4a1c-a35e-37d2ae99d099 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:00:27.464555 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0ab0c18e-36bd-4a1c-a35e-37d2ae99d099 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:00:27.471336 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0ab0c18e-36bd-4a1c-a35e-37d2ae99d099 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:27.471849 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0ab0c18e-36bd-4a1c-a35e-37d2ae99d099 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:27.472275 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0ab0c18e-36bd-4a1c-a35e-37d2ae99d099 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:27.472957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0ab0c18e-36bd-4a1c-a35e-37d2ae99d099 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:27.473514 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0ab0c18e-36bd-4a1c-a35e-37d2ae99d099 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:27.473935 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0ab0c18e-36bd-4a1c-a35e-37d2ae99d099 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:27.610136 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-0ab0c18e-36bd-4a1c-a35e-37d2ae99d099 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:00:27.618450 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0ab0c18e-36bd-4a1c-a35e-37d2ae99d099 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1258 microversion: 2.1 time: 0.159024 Aug 18 15:00:27.619015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 766/1028] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:00:27 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:00:28.638710 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-cdb35f5d-8db4-4bb2-ab88-4f18c2f08106 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:00:28.639352 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-cdb35f5d-8db4-4bb2-ab88-4f18c2f08106 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:00:28.641560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=2 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 15:00:28.642268 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=8 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 15:00:28.648707 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cdb35f5d-8db4-4bb2-ab88-4f18c2f08106 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:28.649186 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cdb35f5d-8db4-4bb2-ab88-4f18c2f08106 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:28.649612 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cdb35f5d-8db4-4bb2-ab88-4f18c2f08106 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:28.650294 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cdb35f5d-8db4-4bb2-ab88-4f18c2f08106 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:28.650740 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cdb35f5d-8db4-4bb2-ab88-4f18c2f08106 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:28.651154 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cdb35f5d-8db4-4bb2-ab88-4f18c2f08106 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:28.783966 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-cdb35f5d-8db4-4bb2-ab88-4f18c2f08106 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:00:28.792165 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-cdb35f5d-8db4-4bb2-ab88-4f18c2f08106 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1258 microversion: 2.1 time: 0.157271 Aug 18 15:00:28.792730 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 767/1029] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:00:28 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:00:29.813555 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-97b19d31-4c3d-4f9e-b91e-2302ec3180d8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:00:29.814218 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-97b19d31-4c3d-4f9e-b91e-2302ec3180d8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:00:29.821262 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-97b19d31-4c3d-4f9e-b91e-2302ec3180d8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:29.821748 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-97b19d31-4c3d-4f9e-b91e-2302ec3180d8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:29.822204 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-97b19d31-4c3d-4f9e-b91e-2302ec3180d8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:29.822953 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-97b19d31-4c3d-4f9e-b91e-2302ec3180d8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:29.823355 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-97b19d31-4c3d-4f9e-b91e-2302ec3180d8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:29.823828 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-97b19d31-4c3d-4f9e-b91e-2302ec3180d8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:29.960120 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-97b19d31-4c3d-4f9e-b91e-2302ec3180d8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:00:29.967959 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-97b19d31-4c3d-4f9e-b91e-2302ec3180d8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1258 microversion: 2.1 time: 0.158409 Aug 18 15:00:29.968443 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 768/1030] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:00:29 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:00:30.988826 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d966f039-671d-4fc4-a6d1-b979c49e1a73 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:00:30.989479 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d966f039-671d-4fc4-a6d1-b979c49e1a73 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:00:30.996546 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d966f039-671d-4fc4-a6d1-b979c49e1a73 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:30.997030 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d966f039-671d-4fc4-a6d1-b979c49e1a73 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:30.997469 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d966f039-671d-4fc4-a6d1-b979c49e1a73 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:30.998155 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d966f039-671d-4fc4-a6d1-b979c49e1a73 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:30.998607 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d966f039-671d-4fc4-a6d1-b979c49e1a73 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:30.999030 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d966f039-671d-4fc4-a6d1-b979c49e1a73 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:31.132373 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d966f039-671d-4fc4-a6d1-b979c49e1a73 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:00:31.140126 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d966f039-671d-4fc4-a6d1-b979c49e1a73 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1258 microversion: 2.1 time: 0.155049 Aug 18 15:00:31.140942 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 769/1031] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:00:30 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:00:32.161970 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e222b9dc-fa2b-4b5d-98eb-d2b116642eaa tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:00:32.163497 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e222b9dc-fa2b-4b5d-98eb-d2b116642eaa tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:00:32.170820 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e222b9dc-fa2b-4b5d-98eb-d2b116642eaa tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:32.171360 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e222b9dc-fa2b-4b5d-98eb-d2b116642eaa tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:32.171856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e222b9dc-fa2b-4b5d-98eb-d2b116642eaa tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:32.172547 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e222b9dc-fa2b-4b5d-98eb-d2b116642eaa tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:32.172995 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e222b9dc-fa2b-4b5d-98eb-d2b116642eaa tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:32.173412 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e222b9dc-fa2b-4b5d-98eb-d2b116642eaa tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:32.304039 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e222b9dc-fa2b-4b5d-98eb-d2b116642eaa tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:00:32.312331 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e222b9dc-fa2b-4b5d-98eb-d2b116642eaa tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1258 microversion: 2.1 time: 0.154928 Aug 18 15:00:32.312887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 770/1032] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:00:32 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:00:33.333921 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-18b7ed2e-fd2a-413d-8878-d3d486ab19a9 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:00:33.335165 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-18b7ed2e-fd2a-413d-8878-d3d486ab19a9 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:00:33.341564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-18b7ed2e-fd2a-413d-8878-d3d486ab19a9 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:33.342041 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-18b7ed2e-fd2a-413d-8878-d3d486ab19a9 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:33.342466 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-18b7ed2e-fd2a-413d-8878-d3d486ab19a9 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:33.343146 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-18b7ed2e-fd2a-413d-8878-d3d486ab19a9 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:33.343591 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-18b7ed2e-fd2a-413d-8878-d3d486ab19a9 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:33.344094 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-18b7ed2e-fd2a-413d-8878-d3d486ab19a9 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:33.474902 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-18b7ed2e-fd2a-413d-8878-d3d486ab19a9 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:00:33.482599 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-18b7ed2e-fd2a-413d-8878-d3d486ab19a9 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1258 microversion: 2.1 time: 0.152534 Aug 18 15:00:33.483163 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 771/1033] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:00:33 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:00:33.860048 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-ccdc7ca7-bd90-4fc0-9e57-ada4f48443d4 req-53847bee-fd63-4022-8d54-7e5f80363e55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40cbcd5e-57d5-4177-8358-32279c6770d6", "name": "network-vif-plugged", "status": "completed", "tag": "ba5c5ae4-144d-49b9-9e54-5dacaef83b8d"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:00:33.872486 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-ccdc7ca7-bd90-4fc0-9e57-ada4f48443d4 req-53847bee-fd63-4022-8d54-7e5f80363e55 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:33.873041 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-ccdc7ca7-bd90-4fc0-9e57-ada4f48443d4 req-53847bee-fd63-4022-8d54-7e5f80363e55 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:33.873529 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-ccdc7ca7-bd90-4fc0-9e57-ada4f48443d4 req-53847bee-fd63-4022-8d54-7e5f80363e55 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:33.884981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-ccdc7ca7-bd90-4fc0-9e57-ada4f48443d4 req-53847bee-fd63-4022-8d54-7e5f80363e55 service nova] Creating event network-vif-plugged:ba5c5ae4-144d-49b9-9e54-5dacaef83b8d for instance 40cbcd5e-57d5-4177-8358-32279c6770d6 on hv-cinder-85220 Aug 18 15:00:33.890078 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-ccdc7ca7-bd90-4fc0-9e57-ada4f48443d4 req-53847bee-fd63-4022-8d54-7e5f80363e55 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034559 Aug 18 15:00:33.890998 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 772/1034] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 15:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 15:00:34.504324 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f2fda69a-591d-4457-b4e3-54857df8630f tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:00:34.504960 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f2fda69a-591d-4457-b4e3-54857df8630f tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:00:34.512247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f2fda69a-591d-4457-b4e3-54857df8630f tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:34.512727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f2fda69a-591d-4457-b4e3-54857df8630f tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:34.513179 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f2fda69a-591d-4457-b4e3-54857df8630f tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:34.513856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f2fda69a-591d-4457-b4e3-54857df8630f tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:34.514307 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f2fda69a-591d-4457-b4e3-54857df8630f tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:34.514728 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f2fda69a-591d-4457-b4e3-54857df8630f tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:34.648895 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f2fda69a-591d-4457-b4e3-54857df8630f tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:00:34.656890 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f2fda69a-591d-4457-b4e3-54857df8630f tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1258 microversion: 2.1 time: 0.156891 Aug 18 15:00:34.657466 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 773/1035] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:00:34 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:00:35.680054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-40c8a085-7dff-4625-be1f-1dcec8f1a75a tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:00:35.680755 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-40c8a085-7dff-4625-be1f-1dcec8f1a75a tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:00:35.687091 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-40c8a085-7dff-4625-be1f-1dcec8f1a75a tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:35.687575 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-40c8a085-7dff-4625-be1f-1dcec8f1a75a tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:35.688040 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-40c8a085-7dff-4625-be1f-1dcec8f1a75a tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:35.688732 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-40c8a085-7dff-4625-be1f-1dcec8f1a75a tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:35.689184 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-40c8a085-7dff-4625-be1f-1dcec8f1a75a tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:35.689606 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-40c8a085-7dff-4625-be1f-1dcec8f1a75a tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:35.828294 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-40c8a085-7dff-4625-be1f-1dcec8f1a75a tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:00:35.852729 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-40c8a085-7dff-4625-be1f-1dcec8f1a75a tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1258 microversion: 2.1 time: 0.177087 Aug 18 15:00:35.853313 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 774/1036] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:00:35 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1258 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:00:36.874160 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-46c4fedc-3f70-420f-a3ba-4cd4e63f60b7 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:00:36.874808 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-46c4fedc-3f70-420f-a3ba-4cd4e63f60b7 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:00:36.881785 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-46c4fedc-3f70-420f-a3ba-4cd4e63f60b7 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:36.882264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-46c4fedc-3f70-420f-a3ba-4cd4e63f60b7 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:36.882698 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-46c4fedc-3f70-420f-a3ba-4cd4e63f60b7 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:36.883384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-46c4fedc-3f70-420f-a3ba-4cd4e63f60b7 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:36.883998 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-46c4fedc-3f70-420f-a3ba-4cd4e63f60b7 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:36.884422 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-46c4fedc-3f70-420f-a3ba-4cd4e63f60b7 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:36.903487 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=100 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 15:00:37.025834 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-46c4fedc-3f70-420f-a3ba-4cd4e63f60b7 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:00:37.036145 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-46c4fedc-3f70-420f-a3ba-4cd4e63f60b7 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1442 microversion: 2.1 time: 0.165637 Aug 18 15:00:37.037104 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 775/1037] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:00:36 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1442 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:00:37.058042 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-223ae396-3c4c-4f52-9488-fc9d36f30e4b tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:00:37.058830 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-223ae396-3c4c-4f52-9488-fc9d36f30e4b tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:00:37.065737 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-223ae396-3c4c-4f52-9488-fc9d36f30e4b tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:37.066214 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-223ae396-3c4c-4f52-9488-fc9d36f30e4b tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:37.066642 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-223ae396-3c4c-4f52-9488-fc9d36f30e4b tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:37.067323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-223ae396-3c4c-4f52-9488-fc9d36f30e4b tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:37.067913 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-223ae396-3c4c-4f52-9488-fc9d36f30e4b tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:37.068782 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-223ae396-3c4c-4f52-9488-fc9d36f30e4b tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:37.203360 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-223ae396-3c4c-4f52-9488-fc9d36f30e4b tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:00:37.211781 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-223ae396-3c4c-4f52-9488-fc9d36f30e4b tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1442 microversion: 2.1 time: 0.158083 Aug 18 15:00:37.212362 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 776/1038] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:00:37 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1442 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:00:38.972163 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-a7b7ebf9-42a6-48c0-83e1-e68f894df8ec req-8ae2e1ad-557e-4a13-84a2-5149bfee0030 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40cbcd5e-57d5-4177-8358-32279c6770d6", "tag": "ba5c5ae4-144d-49b9-9e54-5dacaef83b8d"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:00:38.982195 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-a7b7ebf9-42a6-48c0-83e1-e68f894df8ec req-8ae2e1ad-557e-4a13-84a2-5149bfee0030 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:38.982668 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-a7b7ebf9-42a6-48c0-83e1-e68f894df8ec req-8ae2e1ad-557e-4a13-84a2-5149bfee0030 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:38.983096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-a7b7ebf9-42a6-48c0-83e1-e68f894df8ec req-8ae2e1ad-557e-4a13-84a2-5149bfee0030 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:38.995054 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-a7b7ebf9-42a6-48c0-83e1-e68f894df8ec req-8ae2e1ad-557e-4a13-84a2-5149bfee0030 service nova] Creating event network-changed:ba5c5ae4-144d-49b9-9e54-5dacaef83b8d for instance 40cbcd5e-57d5-4177-8358-32279c6770d6 on hv-cinder-85220 Aug 18 15:00:39.000226 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-a7b7ebf9-42a6-48c0-83e1-e68f894df8ec req-8ae2e1ad-557e-4a13-84a2-5149bfee0030 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031775 Aug 18 15:00:39.000892 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 777/1039] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 15:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 15:00:58.894508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 15:00:58.895250 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=10 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 15:00:58.899965 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-20d0dc37-abde-4f9e-80ba-3bc7c3230a3f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Action: 'create', calling method: .version_select at 0x7fb2143db5e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2113499146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxbvxB8TWdofyUESFPIW4+KfWC43t6c69PFRzSs+yD4k2/bQMvSlaCbWo4OCK55cz59EN4TeYAPNaD9QjEaB4zYJ1tC8udddAISM8E1tkgqUvVeFYjrDH5mMTiHxGPMaQ=="}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:00:58.917106 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-20d0dc37-abde-4f9e-80ba-3bc7c3230a3f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Getting quotas for project 1f169db98a4549109d83c18d108b8282. Resources: {'key_pairs'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 15:00:58.921032 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-20d0dc37-abde-4f9e-80ba-3bc7c3230a3f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Getting quotas for user 57632501742348109ed397d84c71510a and project 1f169db98a4549109d83c18d108b8282. Resources: {'key_pairs'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 15:00:58.942633 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-20d0dc37-abde-4f9e-80ba-3bc7c3230a3f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.049833 Aug 18 15:00:58.943228 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 778/1040] 10.222.0.36 () {60 vars in 1159 bytes} [Thu Aug 18 15:00:58 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 15:00:58.994817 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3919e2e8-1922-49f2-9c0f-1322f4cbfdaa tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1800579344", "imageRef": "8b947e69-937c-4e9a-8a2b-e63862f776d1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2113499146", "networks": [{"uuid": "fe7aaa28-5849-4827-82c1-e60ca4382ffe"}]}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:00:59.046595 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.network.neutron [None req-3919e2e8-1922-49f2-9c0f-1322f4cbfdaa tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] validate_networks() for [('fe7aaa28-5849-4827-82c1-e60ca4382ffe', None, None, None, None, None)] {{(pid=132268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 15:00:59.679549 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-3919e2e8-1922-49f2-9c0f-1322f4cbfdaa tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Flavor limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 15:00:59.680010 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-3919e2e8-1922-49f2-9c0f-1322f4cbfdaa tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Image limits 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 15:00:59.680484 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-3919e2e8-1922-49f2-9c0f-1322f4cbfdaa tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Flavor pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 15:00:59.680924 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-3919e2e8-1922-49f2-9c0f-1322f4cbfdaa tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Image pref 0:0:0 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 15:00:59.681333 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.virt.hardware [None req-3919e2e8-1922-49f2-9c0f-1322f4cbfdaa tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 15:00:59.690044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3919e2e8-1922-49f2-9c0f-1322f4cbfdaa tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:59.690519 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3919e2e8-1922-49f2-9c0f-1322f4cbfdaa tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:59.690951 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3919e2e8-1922-49f2-9c0f-1322f4cbfdaa tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:59.691724 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3919e2e8-1922-49f2-9c0f-1322f4cbfdaa tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:00:59.692179 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3919e2e8-1922-49f2-9c0f-1322f4cbfdaa tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:00:59.692599 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3919e2e8-1922-49f2-9c0f-1322f4cbfdaa tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:00:59.709377 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-3919e2e8-1922-49f2-9c0f-1322f4cbfdaa tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Getting quotas for project 1f169db98a4549109d83c18d108b8282. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 15:00:59.713325 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.quota [None req-3919e2e8-1922-49f2-9c0f-1322f4cbfdaa tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Getting quotas for user 57632501742348109ed397d84c71510a and project 1f169db98a4549109d83c18d108b8282. Resources: {'ram', 'instances', 'cores'} {{(pid=132268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 15:00:59.724116 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-3919e2e8-1922-49f2-9c0f-1322f4cbfdaa tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Going to run 1 instances... {{(pid=132268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 15:00:59.726404 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-3919e2e8-1922-49f2-9c0f-1322f4cbfdaa tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8b947e69-937c-4e9a-8a2b-e63862f776d1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 15:00:59.773103 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-3919e2e8-1922-49f2-9c0f-1322f4cbfdaa tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.782161 Aug 18 15:00:59.773749 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 779/1041] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Aug 18 15:00:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 15:00:59.784537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8ea7863d-26cc-4f5e-a322-6e1215463740 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:00:59.785174 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-8ea7863d-26cc-4f5e-a322-6e1215463740 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:00:59.838433 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8ea7863d-26cc-4f5e-a322-6e1215463740 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:00:59.845507 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-8ea7863d-26cc-4f5e-a322-6e1215463740 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1259 microversion: 2.1 time: 0.064774 Aug 18 15:00:59.846145 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 780/1042] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:00:59 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1259 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:01:00.866282 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-04cc3ece-9494-4387-ae22-c6b66bc11ff5 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:01:00.866976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-04cc3ece-9494-4387-ae22-c6b66bc11ff5 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:00.876912 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-04cc3ece-9494-4387-ae22-c6b66bc11ff5 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:00.876912 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-04cc3ece-9494-4387-ae22-c6b66bc11ff5 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:00.877374 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-04cc3ece-9494-4387-ae22-c6b66bc11ff5 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:00.878080 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-04cc3ece-9494-4387-ae22-c6b66bc11ff5 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:00.878542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-04cc3ece-9494-4387-ae22-c6b66bc11ff5 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:00.878969 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-04cc3ece-9494-4387-ae22-c6b66bc11ff5 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:00.945249 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-04cc3ece-9494-4387-ae22-c6b66bc11ff5 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:01:00.956231 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-04cc3ece-9494-4387-ae22-c6b66bc11ff5 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1319 microversion: 2.1 time: 0.094365 Aug 18 15:01:00.956806 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 781/1043] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:01:00 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1319 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:01:01.978428 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b0332b70-2007-4411-8a93-ae9ea412c1ff tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:01:01.979105 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b0332b70-2007-4411-8a93-ae9ea412c1ff tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:01.986045 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b0332b70-2007-4411-8a93-ae9ea412c1ff tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:01.986821 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b0332b70-2007-4411-8a93-ae9ea412c1ff tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:01.987427 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b0332b70-2007-4411-8a93-ae9ea412c1ff tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:01.988326 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b0332b70-2007-4411-8a93-ae9ea412c1ff tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:01.988989 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b0332b70-2007-4411-8a93-ae9ea412c1ff tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:01.989587 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b0332b70-2007-4411-8a93-ae9ea412c1ff tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:02.132894 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b0332b70-2007-4411-8a93-ae9ea412c1ff tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:01:02.141094 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b0332b70-2007-4411-8a93-ae9ea412c1ff tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1359 microversion: 2.1 time: 0.166758 Aug 18 15:01:02.141869 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 782/1044] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:01:01 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:01:03.162502 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e690ba5e-19ae-4bbc-af7b-436dab34292f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:01:03.163172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e690ba5e-19ae-4bbc-af7b-436dab34292f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:03.171016 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e690ba5e-19ae-4bbc-af7b-436dab34292f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:03.171498 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e690ba5e-19ae-4bbc-af7b-436dab34292f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:03.172317 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e690ba5e-19ae-4bbc-af7b-436dab34292f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:03.173034 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e690ba5e-19ae-4bbc-af7b-436dab34292f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:03.173508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e690ba5e-19ae-4bbc-af7b-436dab34292f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:03.174130 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e690ba5e-19ae-4bbc-af7b-436dab34292f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:03.315343 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e690ba5e-19ae-4bbc-af7b-436dab34292f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:01:03.324339 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e690ba5e-19ae-4bbc-af7b-436dab34292f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1359 microversion: 2.1 time: 0.165699 Aug 18 15:01:03.325992 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 783/1045] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:01:03 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:01:04.345574 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-64f66c90-7393-4d93-a24c-e71490da063c tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:01:04.346270 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-64f66c90-7393-4d93-a24c-e71490da063c tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:04.352698 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-64f66c90-7393-4d93-a24c-e71490da063c tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:04.353205 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-64f66c90-7393-4d93-a24c-e71490da063c tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:04.353638 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-64f66c90-7393-4d93-a24c-e71490da063c tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:04.354328 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-64f66c90-7393-4d93-a24c-e71490da063c tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:04.354783 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-64f66c90-7393-4d93-a24c-e71490da063c tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:04.355210 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-64f66c90-7393-4d93-a24c-e71490da063c tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:04.504095 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-64f66c90-7393-4d93-a24c-e71490da063c tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:01:04.512534 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-64f66c90-7393-4d93-a24c-e71490da063c tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1359 microversion: 2.1 time: 0.170816 Aug 18 15:01:04.513102 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 784/1046] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:01:04 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:01:05.534507 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-83b000f3-d304-4bc8-8744-8f2da07adb70 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:01:05.536010 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-83b000f3-d304-4bc8-8744-8f2da07adb70 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:05.544300 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-83b000f3-d304-4bc8-8744-8f2da07adb70 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:05.545219 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-83b000f3-d304-4bc8-8744-8f2da07adb70 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:05.545932 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-83b000f3-d304-4bc8-8744-8f2da07adb70 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:05.546959 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-83b000f3-d304-4bc8-8744-8f2da07adb70 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:05.547641 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-83b000f3-d304-4bc8-8744-8f2da07adb70 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:05.548246 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-83b000f3-d304-4bc8-8744-8f2da07adb70 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:05.705006 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-83b000f3-d304-4bc8-8744-8f2da07adb70 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:01:05.714469 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-83b000f3-d304-4bc8-8744-8f2da07adb70 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1359 microversion: 2.1 time: 0.184155 Aug 18 15:01:05.715361 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 785/1047] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:01:05 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:01:06.736216 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-87038c66-8896-49d1-93be-0a6744eb4d92 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:01:06.737670 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-87038c66-8896-49d1-93be-0a6744eb4d92 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:06.755292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-87038c66-8896-49d1-93be-0a6744eb4d92 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:06.755847 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-87038c66-8896-49d1-93be-0a6744eb4d92 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:06.756786 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-87038c66-8896-49d1-93be-0a6744eb4d92 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:06.757559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-87038c66-8896-49d1-93be-0a6744eb4d92 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:06.757961 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-87038c66-8896-49d1-93be-0a6744eb4d92 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:06.758384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-87038c66-8896-49d1-93be-0a6744eb4d92 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:06.915366 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-87038c66-8896-49d1-93be-0a6744eb4d92 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:01:06.924046 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-87038c66-8896-49d1-93be-0a6744eb4d92 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1359 microversion: 2.1 time: 0.191457 Aug 18 15:01:06.924861 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 786/1048] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:01:06 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:01:07.945135 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a0de859a-b5cb-4721-be55-b1e676033a03 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:01:07.946433 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a0de859a-b5cb-4721-be55-b1e676033a03 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:07.953318 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a0de859a-b5cb-4721-be55-b1e676033a03 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:07.953801 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a0de859a-b5cb-4721-be55-b1e676033a03 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:07.954231 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a0de859a-b5cb-4721-be55-b1e676033a03 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:07.954928 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a0de859a-b5cb-4721-be55-b1e676033a03 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:07.955383 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a0de859a-b5cb-4721-be55-b1e676033a03 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:07.955831 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a0de859a-b5cb-4721-be55-b1e676033a03 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:08.100461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-a0de859a-b5cb-4721-be55-b1e676033a03 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:01:08.108425 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a0de859a-b5cb-4721-be55-b1e676033a03 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1359 microversion: 2.1 time: 0.167590 Aug 18 15:01:08.109232 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 787/1049] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:01:07 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:01:09.135364 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-31713c39-d8ab-439b-b528-9bca750681b0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:01:09.136463 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-31713c39-d8ab-439b-b528-9bca750681b0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:09.146972 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-31713c39-d8ab-439b-b528-9bca750681b0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:09.148340 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-31713c39-d8ab-439b-b528-9bca750681b0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:09.149241 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-31713c39-d8ab-439b-b528-9bca750681b0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:09.150427 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-31713c39-d8ab-439b-b528-9bca750681b0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:09.151473 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-31713c39-d8ab-439b-b528-9bca750681b0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:09.152501 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-31713c39-d8ab-439b-b528-9bca750681b0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:09.297169 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-31713c39-d8ab-439b-b528-9bca750681b0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:01:09.305400 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-31713c39-d8ab-439b-b528-9bca750681b0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1359 microversion: 2.1 time: 0.178978 Aug 18 15:01:09.305973 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 788/1050] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:01:09 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:01:10.326484 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-52923f7c-8b2a-4b80-bd3d-320e714cf497 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:01:10.327120 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-52923f7c-8b2a-4b80-bd3d-320e714cf497 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:10.328952 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=2 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 15:01:10.329783 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=12 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 15:01:10.337127 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-52923f7c-8b2a-4b80-bd3d-320e714cf497 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:10.337696 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-52923f7c-8b2a-4b80-bd3d-320e714cf497 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:10.338202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-52923f7c-8b2a-4b80-bd3d-320e714cf497 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:10.338980 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-52923f7c-8b2a-4b80-bd3d-320e714cf497 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:10.339436 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-52923f7c-8b2a-4b80-bd3d-320e714cf497 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:10.339891 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-52923f7c-8b2a-4b80-bd3d-320e714cf497 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:10.473242 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-52923f7c-8b2a-4b80-bd3d-320e714cf497 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:01:10.481609 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-52923f7c-8b2a-4b80-bd3d-320e714cf497 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1359 microversion: 2.1 time: 0.159031 Aug 18 15:01:10.482318 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 789/1051] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:01:10 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:01:10.523713 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-e5aa1989-b23f-4de0-9684-db0940e74c3f req-a98fa8ad-d35e-4901-9072-203d52d8c2b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28033011-8251-4306-907d-9c3215269bfc", "tag": "5b6ea491-2ec5-4942-b0d0-9fb2a0d66e5c"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:01:10.534806 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-e5aa1989-b23f-4de0-9684-db0940e74c3f req-a98fa8ad-d35e-4901-9072-203d52d8c2b0 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:10.535438 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-e5aa1989-b23f-4de0-9684-db0940e74c3f req-a98fa8ad-d35e-4901-9072-203d52d8c2b0 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:10.536163 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-e5aa1989-b23f-4de0-9684-db0940e74c3f req-a98fa8ad-d35e-4901-9072-203d52d8c2b0 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:10.548235 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-e5aa1989-b23f-4de0-9684-db0940e74c3f req-a98fa8ad-d35e-4901-9072-203d52d8c2b0 service nova] Creating event network-changed:5b6ea491-2ec5-4942-b0d0-9fb2a0d66e5c for instance 28033011-8251-4306-907d-9c3215269bfc on hv-cinder-85220 Aug 18 15:01:10.553080 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-e5aa1989-b23f-4de0-9684-db0940e74c3f req-a98fa8ad-d35e-4901-9072-203d52d8c2b0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034621 Aug 18 15:01:10.553833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 790/1052] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 15:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 15:01:11.504710 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-4f00ddc1-200b-4d0b-b224-32df9802346f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:01:11.505359 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-4f00ddc1-200b-4d0b-b224-32df9802346f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:11.511958 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4f00ddc1-200b-4d0b-b224-32df9802346f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:11.512436 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4f00ddc1-200b-4d0b-b224-32df9802346f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:11.512962 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4f00ddc1-200b-4d0b-b224-32df9802346f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:11.513647 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4f00ddc1-200b-4d0b-b224-32df9802346f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:11.514093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4f00ddc1-200b-4d0b-b224-32df9802346f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:11.514509 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4f00ddc1-200b-4d0b-b224-32df9802346f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:11.642108 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-4f00ddc1-200b-4d0b-b224-32df9802346f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:01:11.650322 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-4f00ddc1-200b-4d0b-b224-32df9802346f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1359 microversion: 2.1 time: 0.149849 Aug 18 15:01:11.650875 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 791/1053] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:01:11 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:01:12.671852 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8a9b0a65-b1c8-4fd3-bc0e-be3390778235 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:01:12.672533 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-8a9b0a65-b1c8-4fd3-bc0e-be3390778235 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:12.679068 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8a9b0a65-b1c8-4fd3-bc0e-be3390778235 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:12.679542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8a9b0a65-b1c8-4fd3-bc0e-be3390778235 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:12.680007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8a9b0a65-b1c8-4fd3-bc0e-be3390778235 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:12.680692 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8a9b0a65-b1c8-4fd3-bc0e-be3390778235 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:12.681135 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8a9b0a65-b1c8-4fd3-bc0e-be3390778235 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:12.681550 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8a9b0a65-b1c8-4fd3-bc0e-be3390778235 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:12.810042 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8a9b0a65-b1c8-4fd3-bc0e-be3390778235 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:01:12.817729 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-8a9b0a65-b1c8-4fd3-bc0e-be3390778235 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1359 microversion: 2.1 time: 0.150130 Aug 18 15:01:12.818283 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 792/1054] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:01:12 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:01:13.839475 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-086f7319-53a5-4023-8932-806c5581a0ac tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:01:13.840110 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-086f7319-53a5-4023-8932-806c5581a0ac tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:13.846509 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-086f7319-53a5-4023-8932-806c5581a0ac tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:13.846989 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-086f7319-53a5-4023-8932-806c5581a0ac tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:13.847445 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-086f7319-53a5-4023-8932-806c5581a0ac tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:13.848186 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-086f7319-53a5-4023-8932-806c5581a0ac tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:13.848633 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-086f7319-53a5-4023-8932-806c5581a0ac tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:13.849048 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-086f7319-53a5-4023-8932-806c5581a0ac tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:13.979189 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-086f7319-53a5-4023-8932-806c5581a0ac tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:01:13.986675 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-086f7319-53a5-4023-8932-806c5581a0ac tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1359 microversion: 2.1 time: 0.151051 Aug 18 15:01:13.999872 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 793/1055] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:01:13 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:01:15.008538 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f6e11932-8a48-450a-8793-4b6fd59d6b63 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:01:15.009210 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f6e11932-8a48-450a-8793-4b6fd59d6b63 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:15.015759 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f6e11932-8a48-450a-8793-4b6fd59d6b63 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:15.016237 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f6e11932-8a48-450a-8793-4b6fd59d6b63 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:15.016663 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f6e11932-8a48-450a-8793-4b6fd59d6b63 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:15.017370 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f6e11932-8a48-450a-8793-4b6fd59d6b63 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:15.017813 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f6e11932-8a48-450a-8793-4b6fd59d6b63 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:15.018227 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f6e11932-8a48-450a-8793-4b6fd59d6b63 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:15.146630 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f6e11932-8a48-450a-8793-4b6fd59d6b63 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:01:15.154377 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f6e11932-8a48-450a-8793-4b6fd59d6b63 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1359 microversion: 2.1 time: 0.149610 Aug 18 15:01:15.154869 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 794/1056] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:01:15 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:01:16.026904 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-3c9fa772-249c-44ec-9306-6d9f0fb5845b req-61cd9998-d1e2-46a9-8f0d-c8c2590e4552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28033011-8251-4306-907d-9c3215269bfc", "name": "network-vif-plugged", "status": "completed", "tag": "5b6ea491-2ec5-4942-b0d0-9fb2a0d66e5c"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:01:16.037146 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-3c9fa772-249c-44ec-9306-6d9f0fb5845b req-61cd9998-d1e2-46a9-8f0d-c8c2590e4552 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:16.037559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-3c9fa772-249c-44ec-9306-6d9f0fb5845b req-61cd9998-d1e2-46a9-8f0d-c8c2590e4552 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:16.038076 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-3c9fa772-249c-44ec-9306-6d9f0fb5845b req-61cd9998-d1e2-46a9-8f0d-c8c2590e4552 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:16.049399 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-3c9fa772-249c-44ec-9306-6d9f0fb5845b req-61cd9998-d1e2-46a9-8f0d-c8c2590e4552 service nova] Creating event network-vif-plugged:5b6ea491-2ec5-4942-b0d0-9fb2a0d66e5c for instance 28033011-8251-4306-907d-9c3215269bfc on hv-cinder-85220 Aug 18 15:01:16.054876 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-3c9fa772-249c-44ec-9306-6d9f0fb5845b req-61cd9998-d1e2-46a9-8f0d-c8c2590e4552 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032282 Aug 18 15:01:16.055409 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 795/1057] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 15:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 15:01:16.175759 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-36708d20-03ec-450a-9127-b7574058a7e4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:01:16.176564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-36708d20-03ec-450a-9127-b7574058a7e4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:16.183351 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-36708d20-03ec-450a-9127-b7574058a7e4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:16.183874 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-36708d20-03ec-450a-9127-b7574058a7e4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:16.184311 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-36708d20-03ec-450a-9127-b7574058a7e4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:16.185009 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-36708d20-03ec-450a-9127-b7574058a7e4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:16.185465 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-36708d20-03ec-450a-9127-b7574058a7e4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:16.185892 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-36708d20-03ec-450a-9127-b7574058a7e4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:16.323383 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-36708d20-03ec-450a-9127-b7574058a7e4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:01:16.331585 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-36708d20-03ec-450a-9127-b7574058a7e4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1359 microversion: 2.1 time: 0.160038 Aug 18 15:01:16.332192 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 796/1058] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:01:16 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:01:17.354320 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-9d399dbf-ac9b-4f34-9239-e82d6b30f982 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:01:17.355209 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-9d399dbf-ac9b-4f34-9239-e82d6b30f982 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:17.362901 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9d399dbf-ac9b-4f34-9239-e82d6b30f982 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:17.363373 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9d399dbf-ac9b-4f34-9239-e82d6b30f982 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:17.363831 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9d399dbf-ac9b-4f34-9239-e82d6b30f982 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:17.364522 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9d399dbf-ac9b-4f34-9239-e82d6b30f982 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:17.364968 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9d399dbf-ac9b-4f34-9239-e82d6b30f982 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:17.365384 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9d399dbf-ac9b-4f34-9239-e82d6b30f982 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:17.493708 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-9d399dbf-ac9b-4f34-9239-e82d6b30f982 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:01:17.501980 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-9d399dbf-ac9b-4f34-9239-e82d6b30f982 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1359 microversion: 2.1 time: 0.153164 Aug 18 15:01:17.502542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 797/1059] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:01:17 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:01:18.522644 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3dd19e93-ff94-4e64-a9eb-a4af60d931bc tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:01:18.523316 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-3dd19e93-ff94-4e64-a9eb-a4af60d931bc tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:18.530097 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3dd19e93-ff94-4e64-a9eb-a4af60d931bc tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:18.530574 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3dd19e93-ff94-4e64-a9eb-a4af60d931bc tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:18.531002 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3dd19e93-ff94-4e64-a9eb-a4af60d931bc tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:18.531706 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3dd19e93-ff94-4e64-a9eb-a4af60d931bc tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:18.532157 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3dd19e93-ff94-4e64-a9eb-a4af60d931bc tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:18.532571 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3dd19e93-ff94-4e64-a9eb-a4af60d931bc tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:18.550339 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=100 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 15:01:18.663498 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-3dd19e93-ff94-4e64-a9eb-a4af60d931bc tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:01:18.671666 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-3dd19e93-ff94-4e64-a9eb-a4af60d931bc tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1548 microversion: 2.1 time: 0.152892 Aug 18 15:01:18.672248 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 798/1060] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:01:18 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:01:18.691922 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-83e2fd46-3bd2-46b9-a7d5-0c40617fe19a tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:01:18.692562 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-83e2fd46-3bd2-46b9-a7d5-0c40617fe19a tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:18.698424 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-83e2fd46-3bd2-46b9-a7d5-0c40617fe19a tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:18.698902 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-83e2fd46-3bd2-46b9-a7d5-0c40617fe19a tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:18.699334 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-83e2fd46-3bd2-46b9-a7d5-0c40617fe19a tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:18.700279 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-83e2fd46-3bd2-46b9-a7d5-0c40617fe19a tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:18.700733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-83e2fd46-3bd2-46b9-a7d5-0c40617fe19a tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:18.701154 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-83e2fd46-3bd2-46b9-a7d5-0c40617fe19a tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:18.826458 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-83e2fd46-3bd2-46b9-a7d5-0c40617fe19a tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:01:18.834417 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-83e2fd46-3bd2-46b9-a7d5-0c40617fe19a tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1548 microversion: 2.1 time: 0.146067 Aug 18 15:01:18.834983 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 799/1061] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:01:18 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1548 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:01:18.853771 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-140ab349-4a95-4287-b9b9-db6348b32a77 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:01:18.858401 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-140ab349-4a95-4287-b9b9-db6348b32a77 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:01:18.859246 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-140ab349-4a95-4287-b9b9-db6348b32a77 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Searching by: {'deleted': False, 'project_id': '1f169db98a4549109d83c18d108b8282'} {{(pid=132268) get_all /opt/stack/nova/nova/compute/api.py:3007}} Aug 18 15:01:18.865629 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-140ab349-4a95-4287-b9b9-db6348b32a77 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:18.866101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-140ab349-4a95-4287-b9b9-db6348b32a77 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:18.866529 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-140ab349-4a95-4287-b9b9-db6348b32a77 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:18.867805 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-140ab349-4a95-4287-b9b9-db6348b32a77 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:18.868261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-140ab349-4a95-4287-b9b9-db6348b32a77 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:18.868684 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-140ab349-4a95-4287-b9b9-db6348b32a77 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:18.957015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.multi_cell_list [None req-140ab349-4a95-4287-b9b9-db6348b32a77 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132268) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 15:01:19.052562 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-140ab349-4a95-4287-b9b9-db6348b32a77 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.202783 Aug 18 15:01:19.053148 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 800/1062] 10.222.0.36 () {58 vars in 1125 bytes} [Thu Aug 18 15:01:18 2022] GET /compute/v2.1/servers => generated 343 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 15:01:19.063988 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e68d2d30-ab87-4cec-bba0-5779445a9897 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:01:19.064592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e68d2d30-ab87-4cec-bba0-5779445a9897 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:19.070330 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e68d2d30-ab87-4cec-bba0-5779445a9897 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:19.070808 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e68d2d30-ab87-4cec-bba0-5779445a9897 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:19.071242 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e68d2d30-ab87-4cec-bba0-5779445a9897 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:19.071946 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e68d2d30-ab87-4cec-bba0-5779445a9897 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:19.072399 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e68d2d30-ab87-4cec-bba0-5779445a9897 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:19.072822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e68d2d30-ab87-4cec-bba0-5779445a9897 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:19.198719 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e68d2d30-ab87-4cec-bba0-5779445a9897 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:01:19.206468 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e68d2d30-ab87-4cec-bba0-5779445a9897 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1548 microversion: 2.1 time: 0.145983 Aug 18 15:01:19.207035 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 801/1063] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:01:19 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1548 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:01:20.737030 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-79bc7e99-2606-4504-8a95-f22d8783b89b tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c936d00-39dc-4a3c-bb2e-f10aaacb6630"}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:01:20.739345 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-79bc7e99-2606-4504-8a95-f22d8783b89b tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:20.745886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-79bc7e99-2606-4504-8a95-f22d8783b89b tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:20.746366 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-79bc7e99-2606-4504-8a95-f22d8783b89b tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:20.746798 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-79bc7e99-2606-4504-8a95-f22d8783b89b tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:20.747485 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-79bc7e99-2606-4504-8a95-f22d8783b89b tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:20.747961 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-79bc7e99-2606-4504-8a95-f22d8783b89b tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:20.748382 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-79bc7e99-2606-4504-8a95-f22d8783b89b tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:21.170418 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-79bc7e99-2606-4504-8a95-f22d8783b89b tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "POST /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.436753 Aug 18 15:01:21.171025 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 802/1064] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Aug 18 15:01:20 2022] POST /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc/os-volume_attachments => generated 194 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 15:01:34.023207 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-4ccb9b7b-59db-4c17-9934-b34152a2896d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:01:34.023937 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-4ccb9b7b-59db-4c17-9934-b34152a2896d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:34.026505 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell0:SELECT=2 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 15:01:34.027883 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 15:01:34.028425 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 15:01:34.034607 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4ccb9b7b-59db-4c17-9934-b34152a2896d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:34.035084 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4ccb9b7b-59db-4c17-9934-b34152a2896d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:34.035510 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4ccb9b7b-59db-4c17-9934-b34152a2896d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:34.036216 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4ccb9b7b-59db-4c17-9934-b34152a2896d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:34.036664 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4ccb9b7b-59db-4c17-9934-b34152a2896d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:34.037109 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4ccb9b7b-59db-4c17-9934-b34152a2896d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:34.170627 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-4ccb9b7b-59db-4c17-9934-b34152a2896d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:01:34.178811 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-4ccb9b7b-59db-4c17-9934-b34152a2896d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1594 microversion: 2.1 time: 0.159787 Aug 18 15:01:34.179379 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 803/1065] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:01:34 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1594 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:01:36.088913 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-c01e4f0c-f182-494f-8f86-e8c0407bd9d2 req-863f7453-8029-4f4c-9303-1d1c5ecf6a05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28033011-8251-4306-907d-9c3215269bfc", "tag": "5b6ea491-2ec5-4942-b0d0-9fb2a0d66e5c"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:01:36.100350 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-c01e4f0c-f182-494f-8f86-e8c0407bd9d2 req-863f7453-8029-4f4c-9303-1d1c5ecf6a05 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:36.100840 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-c01e4f0c-f182-494f-8f86-e8c0407bd9d2 req-863f7453-8029-4f4c-9303-1d1c5ecf6a05 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:36.101271 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-c01e4f0c-f182-494f-8f86-e8c0407bd9d2 req-863f7453-8029-4f4c-9303-1d1c5ecf6a05 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:36.114052 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-c01e4f0c-f182-494f-8f86-e8c0407bd9d2 req-863f7453-8029-4f4c-9303-1d1c5ecf6a05 service nova] Creating event network-changed:5b6ea491-2ec5-4942-b0d0-9fb2a0d66e5c for instance 28033011-8251-4306-907d-9c3215269bfc on hv-cinder-85220 Aug 18 15:01:36.119249 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-c01e4f0c-f182-494f-8f86-e8c0407bd9d2 req-863f7453-8029-4f4c-9303-1d1c5ecf6a05 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034209 Aug 18 15:01:36.119922 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 804/1066] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 15:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 15:01:37.197755 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-997e10ad-6026-440c-9ace-2f041624c0ff tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-530573814"}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:01:37.198871 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-997e10ad-6026-440c-9ace-2f041624c0ff tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:37.210720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-997e10ad-6026-440c-9ace-2f041624c0ff tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:37.211560 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-997e10ad-6026-440c-9ace-2f041624c0ff tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:37.212666 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-997e10ad-6026-440c-9ace-2f041624c0ff tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:37.213937 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-997e10ad-6026-440c-9ace-2f041624c0ff tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:37.215277 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-997e10ad-6026-440c-9ace-2f041624c0ff tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:37.216084 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-997e10ad-6026-440c-9ace-2f041624c0ff tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:37.382194 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.network.security_group_api [None req-997e10ad-6026-440c-9ace-2f041624c0ff tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Adding security group 09bea26e-6c62-4406-aaa8-4f8c3695fdda to port 5b6ea491-2ec5-4942-b0d0-9fb2a0d66e5c Aug 18 15:01:37.705118 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-997e10ad-6026-440c-9ace-2f041624c0ff tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "POST /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc/action" status: 202 len: 0 microversion: 2.1 time: 0.515450 Aug 18 15:01:37.705762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 805/1067] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Aug 18 15:01:37 2022] POST /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 15:01:37.713593 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f6a279d8-9c4b-47da-9a9b-88fae6016e09 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:01:37.714205 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f6a279d8-9c4b-47da-9a9b-88fae6016e09 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:37.720143 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f6a279d8-9c4b-47da-9a9b-88fae6016e09 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:37.720622 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f6a279d8-9c4b-47da-9a9b-88fae6016e09 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:37.721057 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f6a279d8-9c4b-47da-9a9b-88fae6016e09 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:37.721751 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f6a279d8-9c4b-47da-9a9b-88fae6016e09 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:37.722207 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f6a279d8-9c4b-47da-9a9b-88fae6016e09 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:37.722634 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f6a279d8-9c4b-47da-9a9b-88fae6016e09 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:37.878639 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f6a279d8-9c4b-47da-9a9b-88fae6016e09 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:01:37.887790 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f6a279d8-9c4b-47da-9a9b-88fae6016e09 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1758 microversion: 2.1 time: 0.177791 Aug 18 15:01:37.888380 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 806/1068] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:01:37 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:01:37.893134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-3ca74041-b0a5-4344-a21f-ea70705860f7 req-251903f3-c38f-48ae-a59e-9e23d755deb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28033011-8251-4306-907d-9c3215269bfc", "tag": "5b6ea491-2ec5-4942-b0d0-9fb2a0d66e5c"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:01:37.906171 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-3ca74041-b0a5-4344-a21f-ea70705860f7 req-251903f3-c38f-48ae-a59e-9e23d755deb7 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:37.906667 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-3ca74041-b0a5-4344-a21f-ea70705860f7 req-251903f3-c38f-48ae-a59e-9e23d755deb7 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:37.907304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-3ca74041-b0a5-4344-a21f-ea70705860f7 req-251903f3-c38f-48ae-a59e-9e23d755deb7 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:37.922800 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-3ca74041-b0a5-4344-a21f-ea70705860f7 req-251903f3-c38f-48ae-a59e-9e23d755deb7 service nova] Creating event network-changed:5b6ea491-2ec5-4942-b0d0-9fb2a0d66e5c for instance 28033011-8251-4306-907d-9c3215269bfc on hv-cinder-85220 Aug 18 15:01:37.927859 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-3ca74041-b0a5-4344-a21f-ea70705860f7 req-251903f3-c38f-48ae-a59e-9e23d755deb7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038306 Aug 18 15:01:37.928632 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 807/1069] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 15:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 15:01:52.939762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3d424c90-2190-4e42-8c1d-8f4680f59170 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:01:52.942052 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-3d424c90-2190-4e42-8c1d-8f4680f59170 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:52.945708 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=10 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 15:01:52.946330 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=20 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 15:01:52.951103 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3d424c90-2190-4e42-8c1d-8f4680f59170 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:52.951573 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3d424c90-2190-4e42-8c1d-8f4680f59170 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:52.952033 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3d424c90-2190-4e42-8c1d-8f4680f59170 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:52.952716 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3d424c90-2190-4e42-8c1d-8f4680f59170 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:52.953181 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3d424c90-2190-4e42-8c1d-8f4680f59170 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:52.953604 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3d424c90-2190-4e42-8c1d-8f4680f59170 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:53.026378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-3d424c90-2190-4e42-8c1d-8f4680f59170 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "POST /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc/action" status: 202 len: 0 microversion: 2.1 time: 0.090651 Aug 18 15:01:53.027034 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 808/1070] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Aug 18 15:01:52 2022] POST /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 15:01:53.035722 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-cbb0c407-a676-4e0f-821b-c9d97438e36f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:01:53.036449 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-cbb0c407-a676-4e0f-821b-c9d97438e36f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:53.043879 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cbb0c407-a676-4e0f-821b-c9d97438e36f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:53.044694 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cbb0c407-a676-4e0f-821b-c9d97438e36f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:53.045159 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cbb0c407-a676-4e0f-821b-c9d97438e36f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:53.046069 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cbb0c407-a676-4e0f-821b-c9d97438e36f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:53.046537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cbb0c407-a676-4e0f-821b-c9d97438e36f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:53.046992 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-cbb0c407-a676-4e0f-821b-c9d97438e36f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:53.195867 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-cbb0c407-a676-4e0f-821b-c9d97438e36f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:01:53.204202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-cbb0c407-a676-4e0f-821b-c9d97438e36f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1750 microversion: 2.1 time: 0.172628 Aug 18 15:01:53.204762 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 809/1071] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:01:53 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:01:54.225997 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8759a76d-ee04-4d4a-91f9-71841080dbc0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:01:54.226650 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-8759a76d-ee04-4d4a-91f9-71841080dbc0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:54.233353 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8759a76d-ee04-4d4a-91f9-71841080dbc0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:54.233826 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8759a76d-ee04-4d4a-91f9-71841080dbc0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:54.234256 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8759a76d-ee04-4d4a-91f9-71841080dbc0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:54.234943 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8759a76d-ee04-4d4a-91f9-71841080dbc0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:54.235444 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8759a76d-ee04-4d4a-91f9-71841080dbc0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:54.235863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8759a76d-ee04-4d4a-91f9-71841080dbc0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:54.383766 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8759a76d-ee04-4d4a-91f9-71841080dbc0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:01:54.393380 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-8759a76d-ee04-4d4a-91f9-71841080dbc0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1755 microversion: 2.1 time: 0.171229 Aug 18 15:01:54.394183 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 810/1072] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:01:54 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:01:55.415520 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-1640e5df-8e06-4217-ae06-e3666e0474b4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:01:55.416243 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-1640e5df-8e06-4217-ae06-e3666e0474b4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:55.422546 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1640e5df-8e06-4217-ae06-e3666e0474b4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:55.423026 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1640e5df-8e06-4217-ae06-e3666e0474b4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:55.423459 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1640e5df-8e06-4217-ae06-e3666e0474b4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:55.424238 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1640e5df-8e06-4217-ae06-e3666e0474b4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:55.424688 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1640e5df-8e06-4217-ae06-e3666e0474b4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:55.425114 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1640e5df-8e06-4217-ae06-e3666e0474b4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:55.567103 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-1640e5df-8e06-4217-ae06-e3666e0474b4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:01:55.575358 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-1640e5df-8e06-4217-ae06-e3666e0474b4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1755 microversion: 2.1 time: 0.163740 Aug 18 15:01:55.575977 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 811/1073] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:01:55 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:01:56.597024 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ad43f53f-7cb6-4aec-9b35-f1609eb4437d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:01:56.597661 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ad43f53f-7cb6-4aec-9b35-f1609eb4437d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:56.603594 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ad43f53f-7cb6-4aec-9b35-f1609eb4437d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:56.604106 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ad43f53f-7cb6-4aec-9b35-f1609eb4437d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:56.604537 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ad43f53f-7cb6-4aec-9b35-f1609eb4437d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:56.605307 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ad43f53f-7cb6-4aec-9b35-f1609eb4437d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:56.605674 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ad43f53f-7cb6-4aec-9b35-f1609eb4437d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:56.606097 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ad43f53f-7cb6-4aec-9b35-f1609eb4437d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:56.754369 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ad43f53f-7cb6-4aec-9b35-f1609eb4437d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:01:56.762645 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-ad43f53f-7cb6-4aec-9b35-f1609eb4437d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1755 microversion: 2.1 time: 0.169779 Aug 18 15:01:56.763206 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 812/1074] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:01:56 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:01:57.784074 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5e8d01ad-ed9b-40f4-ab76-2b7df8df4874 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:01:57.784764 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-5e8d01ad-ed9b-40f4-ab76-2b7df8df4874 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:57.790953 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5e8d01ad-ed9b-40f4-ab76-2b7df8df4874 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:57.791423 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5e8d01ad-ed9b-40f4-ab76-2b7df8df4874 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:57.792010 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5e8d01ad-ed9b-40f4-ab76-2b7df8df4874 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:57.792683 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5e8d01ad-ed9b-40f4-ab76-2b7df8df4874 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:57.793618 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5e8d01ad-ed9b-40f4-ab76-2b7df8df4874 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:57.794031 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5e8d01ad-ed9b-40f4-ab76-2b7df8df4874 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:57.937147 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-5e8d01ad-ed9b-40f4-ab76-2b7df8df4874 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:01:57.945295 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-5e8d01ad-ed9b-40f4-ab76-2b7df8df4874 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1755 microversion: 2.1 time: 0.165115 Aug 18 15:01:57.945847 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 813/1075] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:01:57 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:01:58.966974 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2be59b3a-ad24-48f7-9f00-b0633bcc7a7d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:01:58.967599 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2be59b3a-ad24-48f7-9f00-b0633bcc7a7d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:01:58.973968 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2be59b3a-ad24-48f7-9f00-b0633bcc7a7d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:58.974444 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2be59b3a-ad24-48f7-9f00-b0633bcc7a7d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:58.974872 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2be59b3a-ad24-48f7-9f00-b0633bcc7a7d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:58.975555 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2be59b3a-ad24-48f7-9f00-b0633bcc7a7d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:01:58.976027 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2be59b3a-ad24-48f7-9f00-b0633bcc7a7d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:01:58.976452 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2be59b3a-ad24-48f7-9f00-b0633bcc7a7d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:01:59.117513 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2be59b3a-ad24-48f7-9f00-b0633bcc7a7d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:01:59.125686 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2be59b3a-ad24-48f7-9f00-b0633bcc7a7d tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1755 microversion: 2.1 time: 0.163094 Aug 18 15:01:59.126243 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 814/1076] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:01:58 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:02:00.149086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3c362249-e2bd-4f81-8e88-bc5dc424b2a5 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:00.149722 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-3c362249-e2bd-4f81-8e88-bc5dc424b2a5 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:00.156109 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3c362249-e2bd-4f81-8e88-bc5dc424b2a5 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:00.156586 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3c362249-e2bd-4f81-8e88-bc5dc424b2a5 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:00.157014 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3c362249-e2bd-4f81-8e88-bc5dc424b2a5 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:00.157698 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3c362249-e2bd-4f81-8e88-bc5dc424b2a5 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:00.158147 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3c362249-e2bd-4f81-8e88-bc5dc424b2a5 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:00.158567 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3c362249-e2bd-4f81-8e88-bc5dc424b2a5 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:00.302473 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-3c362249-e2bd-4f81-8e88-bc5dc424b2a5 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:00.310709 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-3c362249-e2bd-4f81-8e88-bc5dc424b2a5 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1755 microversion: 2.1 time: 0.165605 Aug 18 15:02:00.311273 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 815/1077] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:00 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:02:01.331644 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-9ad34848-c428-498b-9f2d-ad88725f27ca tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:01.332341 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-9ad34848-c428-498b-9f2d-ad88725f27ca tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:01.338664 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9ad34848-c428-498b-9f2d-ad88725f27ca tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:01.339140 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9ad34848-c428-498b-9f2d-ad88725f27ca tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:01.339640 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9ad34848-c428-498b-9f2d-ad88725f27ca tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:01.340404 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9ad34848-c428-498b-9f2d-ad88725f27ca tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:01.340858 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9ad34848-c428-498b-9f2d-ad88725f27ca tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:01.341278 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9ad34848-c428-498b-9f2d-ad88725f27ca tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:01.481461 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-9ad34848-c428-498b-9f2d-ad88725f27ca tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:01.489695 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-9ad34848-c428-498b-9f2d-ad88725f27ca tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1755 microversion: 2.1 time: 0.161855 Aug 18 15:02:01.490256 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 816/1078] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:01 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:02:02.510521 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5229e51b-60e5-4365-bca7-e83344af50ba tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:02.511363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-5229e51b-60e5-4365-bca7-e83344af50ba tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:02.518156 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5229e51b-60e5-4365-bca7-e83344af50ba tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:02.518636 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5229e51b-60e5-4365-bca7-e83344af50ba tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:02.519075 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5229e51b-60e5-4365-bca7-e83344af50ba tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:02.519800 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5229e51b-60e5-4365-bca7-e83344af50ba tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:02.520263 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5229e51b-60e5-4365-bca7-e83344af50ba tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:02.520682 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5229e51b-60e5-4365-bca7-e83344af50ba tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:02.670019 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-5229e51b-60e5-4365-bca7-e83344af50ba tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:02.678250 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-5229e51b-60e5-4365-bca7-e83344af50ba tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1755 microversion: 2.1 time: 0.171573 Aug 18 15:02:02.678817 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 817/1079] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:02 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:02:03.700270 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-613b7d60-3c27-4147-9182-3233ac49cd8c tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:03.700895 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-613b7d60-3c27-4147-9182-3233ac49cd8c tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:03.707511 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-613b7d60-3c27-4147-9182-3233ac49cd8c tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:03.708029 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-613b7d60-3c27-4147-9182-3233ac49cd8c tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:03.708462 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-613b7d60-3c27-4147-9182-3233ac49cd8c tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:03.709148 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-613b7d60-3c27-4147-9182-3233ac49cd8c tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:03.709598 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-613b7d60-3c27-4147-9182-3233ac49cd8c tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:03.710019 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-613b7d60-3c27-4147-9182-3233ac49cd8c tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:03.851381 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-613b7d60-3c27-4147-9182-3233ac49cd8c tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:03.859612 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-613b7d60-3c27-4147-9182-3233ac49cd8c tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1755 microversion: 2.1 time: 0.163832 Aug 18 15:02:03.860201 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 818/1080] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:03 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 15:02:04.775740 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d7931e52-7bb6-44b6-b06b-ba3f6e3a7344 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:04.776344 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d7931e52-7bb6-44b6-b06b-ba3f6e3a7344 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 5f2d59d8-2292-4b8d-81f1-5b7d347a1268] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:04.783259 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d7931e52-7bb6-44b6-b06b-ba3f6e3a7344 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:04.783766 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d7931e52-7bb6-44b6-b06b-ba3f6e3a7344 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:04.784204 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d7931e52-7bb6-44b6-b06b-ba3f6e3a7344 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:04.784888 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d7931e52-7bb6-44b6-b06b-ba3f6e3a7344 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:04.785342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d7931e52-7bb6-44b6-b06b-ba3f6e3a7344 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:04.785767 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d7931e52-7bb6-44b6-b06b-ba3f6e3a7344 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:04.812504 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d7931e52-7bb6-44b6-b06b-ba3f6e3a7344 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 5f2d59d8-2292-4b8d-81f1-5b7d347a1268] Going to try to terminate instance {{(pid=132268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 15:02:04.889546 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d7931e52-7bb6-44b6-b06b-ba3f6e3a7344 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268" status: 204 len: 0 microversion: 2.1 time: 0.117256 Aug 18 15:02:04.890305 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 819/1081] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 15:02:04 2022] DELETE /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 15:02:04.962475 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-2264f979-2443-4ba9-bdff-7b53becff4bb req-7c045473-c11a-46fe-af43-0399098e275f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f2d59d8-2292-4b8d-81f1-5b7d347a1268", "tag": "5902a59f-c00d-4868-b91b-03d7c9ac623f"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:02:04.972397 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-2264f979-2443-4ba9-bdff-7b53becff4bb req-7c045473-c11a-46fe-af43-0399098e275f service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:04.975261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-2264f979-2443-4ba9-bdff-7b53becff4bb req-7c045473-c11a-46fe-af43-0399098e275f service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:04.975261 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-2264f979-2443-4ba9-bdff-7b53becff4bb req-7c045473-c11a-46fe-af43-0399098e275f service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:04.990621 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-2264f979-2443-4ba9-bdff-7b53becff4bb req-7c045473-c11a-46fe-af43-0399098e275f service nova] Creating event network-changed:5902a59f-c00d-4868-b91b-03d7c9ac623f for instance 5f2d59d8-2292-4b8d-81f1-5b7d347a1268 on hv-cinder-85220 Aug 18 15:02:04.995474 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-2264f979-2443-4ba9-bdff-7b53becff4bb req-7c045473-c11a-46fe-af43-0399098e275f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103859 Aug 18 15:02:04.996822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 820/1082] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 15:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 15:02:05.004510 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-94b1381d-d5c3-48bf-9ed9-01814638d372 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:05.005204 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-94b1381d-d5c3-48bf-9ed9-01814638d372 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:05.011494 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-94b1381d-d5c3-48bf-9ed9-01814638d372 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:05.012022 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-94b1381d-d5c3-48bf-9ed9-01814638d372 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:05.012439 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-94b1381d-d5c3-48bf-9ed9-01814638d372 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:05.013123 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-94b1381d-d5c3-48bf-9ed9-01814638d372 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:05.013567 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-94b1381d-d5c3-48bf-9ed9-01814638d372 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:05.013985 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-94b1381d-d5c3-48bf-9ed9-01814638d372 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:05.179403 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-94b1381d-d5c3-48bf-9ed9-01814638d372 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:05.188362 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-94b1381d-d5c3-48bf-9ed9-01814638d372 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1755 microversion: 2.1 time: 0.187827 Aug 18 15:02:05.188923 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 821/1083] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:04 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 15:02:05.193308 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8e3c45fb-7317-435a-becd-d2b624ed26cd tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:05.193910 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-8e3c45fb-7317-435a-becd-d2b624ed26cd tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 5f2d59d8-2292-4b8d-81f1-5b7d347a1268] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:05.199863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8e3c45fb-7317-435a-becd-d2b624ed26cd tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:05.200442 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8e3c45fb-7317-435a-becd-d2b624ed26cd tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:05.200771 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8e3c45fb-7317-435a-becd-d2b624ed26cd tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:05.201501 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8e3c45fb-7317-435a-becd-d2b624ed26cd tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:05.201880 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8e3c45fb-7317-435a-becd-d2b624ed26cd tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:05.202293 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8e3c45fb-7317-435a-becd-d2b624ed26cd tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:05.222924 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 15:02:05.334099 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8e3c45fb-7317-435a-becd-d2b624ed26cd tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:05.343077 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-8e3c45fb-7317-435a-becd-d2b624ed26cd tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268" status: 200 len: 1575 microversion: 2.1 time: 0.153162 Aug 18 15:02:05.343657 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 822/1084] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:05 2022] GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 15:02:06.209592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-7095e9c0-fd4b-47b8-bd24-aa26dc7a8fc7 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:06.210287 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-7095e9c0-fd4b-47b8-bd24-aa26dc7a8fc7 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:06.216757 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7095e9c0-fd4b-47b8-bd24-aa26dc7a8fc7 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:06.217232 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7095e9c0-fd4b-47b8-bd24-aa26dc7a8fc7 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:06.217660 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7095e9c0-fd4b-47b8-bd24-aa26dc7a8fc7 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:06.218342 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7095e9c0-fd4b-47b8-bd24-aa26dc7a8fc7 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:06.218782 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7095e9c0-fd4b-47b8-bd24-aa26dc7a8fc7 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:06.219198 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-7095e9c0-fd4b-47b8-bd24-aa26dc7a8fc7 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:06.361011 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-7095e9c0-fd4b-47b8-bd24-aa26dc7a8fc7 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:06.369844 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-7095e9c0-fd4b-47b8-bd24-aa26dc7a8fc7 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1758 microversion: 2.1 time: 0.164147 Aug 18 15:02:06.370415 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 823/1085] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:06 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:02:06.375702 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-29f7557a-4d2f-4834-99fb-edb62b63b696 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:06.376303 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-29f7557a-4d2f-4834-99fb-edb62b63b696 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 5f2d59d8-2292-4b8d-81f1-5b7d347a1268] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:06.382185 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-29f7557a-4d2f-4834-99fb-edb62b63b696 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:06.382748 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-29f7557a-4d2f-4834-99fb-edb62b63b696 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:06.383210 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-29f7557a-4d2f-4834-99fb-edb62b63b696 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:06.383924 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-29f7557a-4d2f-4834-99fb-edb62b63b696 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:06.384373 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-29f7557a-4d2f-4834-99fb-edb62b63b696 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:06.384884 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-29f7557a-4d2f-4834-99fb-edb62b63b696 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:06.526893 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-29f7557a-4d2f-4834-99fb-edb62b63b696 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:06.534829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-29f7557a-4d2f-4834-99fb-edb62b63b696 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268" status: 200 len: 1575 microversion: 2.1 time: 0.162571 Aug 18 15:02:06.535403 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 824/1086] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:06 2022] GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 15:02:07.556958 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0ce4d495-0834-40df-9bcf-bf864a20f707 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:07.557618 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0ce4d495-0834-40df-9bcf-bf864a20f707 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 5f2d59d8-2292-4b8d-81f1-5b7d347a1268] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:07.564115 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0ce4d495-0834-40df-9bcf-bf864a20f707 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:07.564674 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0ce4d495-0834-40df-9bcf-bf864a20f707 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:07.565194 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0ce4d495-0834-40df-9bcf-bf864a20f707 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:07.565979 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0ce4d495-0834-40df-9bcf-bf864a20f707 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:07.566597 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0ce4d495-0834-40df-9bcf-bf864a20f707 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:07.566916 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0ce4d495-0834-40df-9bcf-bf864a20f707 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:07.702100 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-0ce4d495-0834-40df-9bcf-bf864a20f707 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:07.710042 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0ce4d495-0834-40df-9bcf-bf864a20f707 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268" status: 200 len: 1457 microversion: 2.1 time: 0.156954 Aug 18 15:02:07.710621 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 825/1087] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:07 2022] GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268 => generated 1457 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:02:07.803765 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-f3c458d3-d05f-4ee7-b994-9a8624239440 req-136a183f-2588-4ff9-9158-1d87f1ecb08f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f2d59d8-2292-4b8d-81f1-5b7d347a1268", "name": "network-vif-deleted", "tag": "5902a59f-c00d-4868-b91b-03d7c9ac623f"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:02:07.813253 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-f3c458d3-d05f-4ee7-b994-9a8624239440 req-136a183f-2588-4ff9-9158-1d87f1ecb08f service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:07.813733 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-f3c458d3-d05f-4ee7-b994-9a8624239440 req-136a183f-2588-4ff9-9158-1d87f1ecb08f service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:07.814155 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-f3c458d3-d05f-4ee7-b994-9a8624239440 req-136a183f-2588-4ff9-9158-1d87f1ecb08f service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:07.825208 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-f3c458d3-d05f-4ee7-b994-9a8624239440 req-136a183f-2588-4ff9-9158-1d87f1ecb08f service nova] Creating event network-vif-deleted:5902a59f-c00d-4868-b91b-03d7c9ac623f for instance 5f2d59d8-2292-4b8d-81f1-5b7d347a1268 on hv-cinder-85220 Aug 18 15:02:07.830660 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-f3c458d3-d05f-4ee7-b994-9a8624239440 req-136a183f-2588-4ff9-9158-1d87f1ecb08f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030653 Aug 18 15:02:07.831599 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 826/1088] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 15:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 15:02:08.735186 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-545b7044-28c9-48f3-a3dc-d038ec511d51 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:08.736009 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-545b7044-28c9-48f3-a3dc-d038ec511d51 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 5f2d59d8-2292-4b8d-81f1-5b7d347a1268] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:08.742325 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-545b7044-28c9-48f3-a3dc-d038ec511d51 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:08.742803 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-545b7044-28c9-48f3-a3dc-d038ec511d51 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:08.743233 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-545b7044-28c9-48f3-a3dc-d038ec511d51 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:08.743940 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-545b7044-28c9-48f3-a3dc-d038ec511d51 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:08.744390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-545b7044-28c9-48f3-a3dc-d038ec511d51 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:08.744805 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-545b7044-28c9-48f3-a3dc-d038ec511d51 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:08.758484 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-545b7044-28c9-48f3-a3dc-d038ec511d51 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] HTTP exception thrown: Instance 5f2d59d8-2292-4b8d-81f1-5b7d347a1268 could not be found. Aug 18 15:02:08.760101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-545b7044-28c9-48f3-a3dc-d038ec511d51 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Request method failure captured: Aug 18 15:02:08.760101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268 HTTP/1.1 Aug 18 15:02:08.760101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 15:02:08.760101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 15:02:08.760101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 15:02:08.760101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 15:02:08.760101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 15:02:08.760101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 15:02:08.760101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 15:02:08.760101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 15:02:08.760101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lJfb-SS07HrKZYcnm0G93u-17_L-cy6H6p9IUQ5JWnD4JLMgxjRx4rRInyQZrAiQOqhb0KlPc-b92LLcz2UnJSsIwaEdO77sQZtc5L3bkSGa-hFFeGrk6WjrVOdYdqjIrq30lNVSwhOovQUG0gHU-XEiaYHlZ9LXcGO3leSj93R1rc Aug 18 15:02:08.760101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 15:02:08.760101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 15:02:08.760101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 15:02:08.760101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 15:02:08.760101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 15:02:08.760101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 15:02:08.760101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: d334ad6bd6194604a61ce4ca95149993 Aug 18 15:02:08.760101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-TestVolumeBootPattern-1402032980 Aug 18 15:02:08.760101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 15:02:08.760101 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 15:02:08.761818 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d334ad6bd6194604a61ce4ca95149993"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d334ad6bd6194604a61ce4ca95149993"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d334ad6bd6194604a61ce4ca95149993", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d334ad6bd6194604a61ce4ca95149993"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 15:02:08.761818 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-TestVolumeBootPattern-1402032980 Aug 18 15:02:08.761818 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: d334ad6bd6194604a61ce4ca95149993 Aug 18 15:02:08.761818 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-TestVolumeBootPattern-1402032980 Aug 18 15:02:08.761818 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-TestVolumeBootPattern-1402032980-project Aug 18 15:02:08.761818 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 15:02:08.761818 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 15:02:08.761818 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: ac4d918f549c41d3ae19e80cecefa95c Aug 18 15:02:08.761818 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-TestVolumeBootPattern-1402032980-project Aug 18 15:02:08.761818 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 15:02:08.761818 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 5f2d59d8-2292-4b8d-81f1-5b7d347a1268 could not be found. Aug 18 15:02:08.761818 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '5f2d59d8-2292-4b8d-81f1-5b7d347a1268'} Aug 18 15:02:08.762887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 15:02:08.762887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 15:02:08.762887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 15:02:08.762887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 15:02:08.762887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 15:02:08.762887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 15:02:08.762887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 15:02:08.762887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 15:02:08.762887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 15:02:08.762887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 15:02:08.762887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f2d59d8-2292-4b8d-81f1-5b7d347a1268 could not be found. Aug 18 15:02:08.762887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:08.762887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 15:02:08.762887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:08.762887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 15:02:08.762887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 15:02:08.762887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 15:02:08.762887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 15:02:08.762887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 15:02:08.762887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 15:02:08.764323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 15:02:08.764323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 15:02:08.764323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 15:02:08.764323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 15:02:08.764323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 15:02:08.764323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 15:02:08.764323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 15:02:08.764323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f2d59d8-2292-4b8d-81f1-5b7d347a1268 could not be found. Aug 18 15:02:08.764323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:08.764323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 15:02:08.764323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:08.764323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 15:02:08.764323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 15:02:08.764323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 15:02:08.764323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 15:02:08.764323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 15:02:08.764323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f2d59d8-2292-4b8d-81f1-5b7d347a1268 could not be found. Aug 18 15:02:08.764323 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:08.765878 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-545b7044-28c9-48f3-a3dc-d038ec511d51 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Returning 404 to user: Instance 5f2d59d8-2292-4b8d-81f1-5b7d347a1268 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 15:02:08.765878 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-545b7044-28c9-48f3-a3dc-d038ec511d51 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268" status: 404 len: 111 microversion: 2.1 time: 0.033855 Aug 18 15:02:08.765878 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 827/1089] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:08 2022] GET /compute/v2.1/servers/5f2d59d8-2292-4b8d-81f1-5b7d347a1268 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 15:02:11.825933 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0a47350a-5bf7-4016-af1e-59f878b9e50d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:11.826591 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0a47350a-5bf7-4016-af1e-59f878b9e50d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 26c1eb76-2063-4c0d-80a1-6c0d9baaace4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:11.833125 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0a47350a-5bf7-4016-af1e-59f878b9e50d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:11.833616 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0a47350a-5bf7-4016-af1e-59f878b9e50d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:11.834033 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0a47350a-5bf7-4016-af1e-59f878b9e50d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:11.834731 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0a47350a-5bf7-4016-af1e-59f878b9e50d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:11.835175 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0a47350a-5bf7-4016-af1e-59f878b9e50d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:11.835591 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0a47350a-5bf7-4016-af1e-59f878b9e50d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:11.861020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0a47350a-5bf7-4016-af1e-59f878b9e50d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 26c1eb76-2063-4c0d-80a1-6c0d9baaace4] Going to try to terminate instance {{(pid=132268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 15:02:11.941763 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0a47350a-5bf7-4016-af1e-59f878b9e50d tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "DELETE /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4" status: 204 len: 0 microversion: 2.1 time: 0.119826 Aug 18 15:02:11.945686 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 828/1090] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 15:02:11 2022] DELETE /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 15:02:11.947810 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-f6e6e412-403b-4398-a33e-6f207f819793 req-efdedd12-fa88-4f55-ba56-0efeb71735a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26c1eb76-2063-4c0d-80a1-6c0d9baaace4", "tag": "87aea118-6682-42ff-87ca-60d074c906df"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:02:11.957349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-f6e6e412-403b-4398-a33e-6f207f819793 req-efdedd12-fa88-4f55-ba56-0efeb71735a3 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:11.957816 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-f6e6e412-403b-4398-a33e-6f207f819793 req-efdedd12-fa88-4f55-ba56-0efeb71735a3 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:11.958236 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-f6e6e412-403b-4398-a33e-6f207f819793 req-efdedd12-fa88-4f55-ba56-0efeb71735a3 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:11.971209 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-f6e6e412-403b-4398-a33e-6f207f819793 req-efdedd12-fa88-4f55-ba56-0efeb71735a3 service nova] Creating event network-changed:87aea118-6682-42ff-87ca-60d074c906df for instance 26c1eb76-2063-4c0d-80a1-6c0d9baaace4 on hv-cinder-85220 Aug 18 15:02:11.976062 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-f6e6e412-403b-4398-a33e-6f207f819793 req-efdedd12-fa88-4f55-ba56-0efeb71735a3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032031 Aug 18 15:02:11.976648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 829/1091] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 15:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 15:02:11.983139 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8b9bc2ab-0250-4ed4-a972-2fda774c15e9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:11.983861 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-8b9bc2ab-0250-4ed4-a972-2fda774c15e9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 26c1eb76-2063-4c0d-80a1-6c0d9baaace4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:11.990377 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b9bc2ab-0250-4ed4-a972-2fda774c15e9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:11.990657 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b9bc2ab-0250-4ed4-a972-2fda774c15e9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:11.991017 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b9bc2ab-0250-4ed4-a972-2fda774c15e9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:11.991871 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b9bc2ab-0250-4ed4-a972-2fda774c15e9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:11.992181 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b9bc2ab-0250-4ed4-a972-2fda774c15e9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:11.992598 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8b9bc2ab-0250-4ed4-a972-2fda774c15e9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:12.129072 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-8b9bc2ab-0250-4ed4-a972-2fda774c15e9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:12.137827 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-8b9bc2ab-0250-4ed4-a972-2fda774c15e9 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4" status: 200 len: 1576 microversion: 2.1 time: 0.158818 Aug 18 15:02:12.138400 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 830/1092] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:11 2022] GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 15:02:13.158934 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-14db7d42-7c3b-4f25-a0a7-add46888ff28 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:13.159603 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-14db7d42-7c3b-4f25-a0a7-add46888ff28 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 26c1eb76-2063-4c0d-80a1-6c0d9baaace4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:13.166146 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-14db7d42-7c3b-4f25-a0a7-add46888ff28 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:13.166640 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-14db7d42-7c3b-4f25-a0a7-add46888ff28 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:13.167056 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-14db7d42-7c3b-4f25-a0a7-add46888ff28 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:13.168432 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-14db7d42-7c3b-4f25-a0a7-add46888ff28 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:13.168886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-14db7d42-7c3b-4f25-a0a7-add46888ff28 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:13.169299 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-14db7d42-7c3b-4f25-a0a7-add46888ff28 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:13.304335 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-14db7d42-7c3b-4f25-a0a7-add46888ff28 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:13.312489 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-14db7d42-7c3b-4f25-a0a7-add46888ff28 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4" status: 200 len: 1576 microversion: 2.1 time: 0.157489 Aug 18 15:02:13.313045 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 831/1093] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:13 2022] GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:02:14.307389 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-b6ad8f40-f334-4e02-9897-6c410cfe7701 req-6c7d1e28-4198-4d9a-be28-f551e756b370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c1eb76-2063-4c0d-80a1-6c0d9baaace4", "name": "network-vif-deleted", "tag": "87aea118-6682-42ff-87ca-60d074c906df"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:02:14.318714 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-b6ad8f40-f334-4e02-9897-6c410cfe7701 req-6c7d1e28-4198-4d9a-be28-f551e756b370 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:14.319233 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-b6ad8f40-f334-4e02-9897-6c410cfe7701 req-6c7d1e28-4198-4d9a-be28-f551e756b370 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:14.319697 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-b6ad8f40-f334-4e02-9897-6c410cfe7701 req-6c7d1e28-4198-4d9a-be28-f551e756b370 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:14.331311 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-b6ad8f40-f334-4e02-9897-6c410cfe7701 req-6c7d1e28-4198-4d9a-be28-f551e756b370 service nova] Creating event network-vif-deleted:87aea118-6682-42ff-87ca-60d074c906df for instance 26c1eb76-2063-4c0d-80a1-6c0d9baaace4 on hv-cinder-85220 Aug 18 15:02:14.336134 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-b6ad8f40-f334-4e02-9897-6c410cfe7701 req-6c7d1e28-4198-4d9a-be28-f551e756b370 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032805 Aug 18 15:02:14.336931 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 832/1094] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 15:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 15:02:14.342407 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c0a4af77-c8ef-41fb-91ac-67224ac16431 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:14.343080 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c0a4af77-c8ef-41fb-91ac-67224ac16431 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 26c1eb76-2063-4c0d-80a1-6c0d9baaace4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:14.349254 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c0a4af77-c8ef-41fb-91ac-67224ac16431 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:14.349808 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c0a4af77-c8ef-41fb-91ac-67224ac16431 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:14.350139 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c0a4af77-c8ef-41fb-91ac-67224ac16431 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:14.350813 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c0a4af77-c8ef-41fb-91ac-67224ac16431 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:14.351262 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c0a4af77-c8ef-41fb-91ac-67224ac16431 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:14.351698 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c0a4af77-c8ef-41fb-91ac-67224ac16431 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:14.414564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c0a4af77-c8ef-41fb-91ac-67224ac16431 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4d918f549c41d3ae19e80cecefa95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334ad6bd6194604a61ce4ca95149993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:14.424320 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c0a4af77-c8ef-41fb-91ac-67224ac16431 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4" status: 200 len: 1224 microversion: 2.1 time: 0.086295 Aug 18 15:02:14.424907 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 833/1095] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:14 2022] GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 15:02:15.446035 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-baced5a9-ba84-4abd-b2ab-a0c18a364cf8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:15.446695 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-baced5a9-ba84-4abd-b2ab-a0c18a364cf8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 26c1eb76-2063-4c0d-80a1-6c0d9baaace4] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:15.453183 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-baced5a9-ba84-4abd-b2ab-a0c18a364cf8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:15.453652 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-baced5a9-ba84-4abd-b2ab-a0c18a364cf8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:15.454078 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-baced5a9-ba84-4abd-b2ab-a0c18a364cf8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:15.454754 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-baced5a9-ba84-4abd-b2ab-a0c18a364cf8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:15.455201 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-baced5a9-ba84-4abd-b2ab-a0c18a364cf8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:15.455613 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-baced5a9-ba84-4abd-b2ab-a0c18a364cf8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:15.469234 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-baced5a9-ba84-4abd-b2ab-a0c18a364cf8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] HTTP exception thrown: Instance 26c1eb76-2063-4c0d-80a1-6c0d9baaace4 could not be found. Aug 18 15:02:15.470829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-baced5a9-ba84-4abd-b2ab-a0c18a364cf8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Request method failure captured: Aug 18 15:02:15.470829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4 HTTP/1.1 Aug 18 15:02:15.470829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 15:02:15.470829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 15:02:15.470829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 15:02:15.470829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 15:02:15.470829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 15:02:15.470829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 15:02:15.470829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 15:02:15.470829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 15:02:15.470829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lJfb-SS07HrKZYcnm0G93u-17_L-cy6H6p9IUQ5JWnD4JLMgxjRx4rRInyQZrAiQOqhb0KlPc-b92LLcz2UnJSsIwaEdO77sQZtc5L3bkSGa-hFFeGrk6WjrVOdYdqjIrq30lNVSwhOovQUG0gHU-XEiaYHlZ9LXcGO3leSj93R1rc Aug 18 15:02:15.470829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 15:02:15.470829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 15:02:15.470829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 15:02:15.470829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 15:02:15.470829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 15:02:15.470829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 15:02:15.470829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: d334ad6bd6194604a61ce4ca95149993 Aug 18 15:02:15.470829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-TestVolumeBootPattern-1402032980 Aug 18 15:02:15.470829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 15:02:15.470829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 15:02:15.472546 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d334ad6bd6194604a61ce4ca95149993"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d334ad6bd6194604a61ce4ca95149993"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d334ad6bd6194604a61ce4ca95149993", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d334ad6bd6194604a61ce4ca95149993"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 15:02:15.472546 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-TestVolumeBootPattern-1402032980 Aug 18 15:02:15.472546 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: d334ad6bd6194604a61ce4ca95149993 Aug 18 15:02:15.472546 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-TestVolumeBootPattern-1402032980 Aug 18 15:02:15.472546 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-TestVolumeBootPattern-1402032980-project Aug 18 15:02:15.472546 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 15:02:15.472546 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 15:02:15.472546 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: ac4d918f549c41d3ae19e80cecefa95c Aug 18 15:02:15.472546 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-TestVolumeBootPattern-1402032980-project Aug 18 15:02:15.472546 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 15:02:15.472546 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 26c1eb76-2063-4c0d-80a1-6c0d9baaace4 could not be found. Aug 18 15:02:15.472546 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '26c1eb76-2063-4c0d-80a1-6c0d9baaace4'} Aug 18 15:02:15.473410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 15:02:15.473410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 15:02:15.473410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 15:02:15.473410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 15:02:15.473410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 15:02:15.473410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 15:02:15.473410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 15:02:15.473410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 15:02:15.473410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 15:02:15.473410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 15:02:15.473410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26c1eb76-2063-4c0d-80a1-6c0d9baaace4 could not be found. Aug 18 15:02:15.473410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:15.473410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 15:02:15.473410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:15.473410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 15:02:15.473410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 15:02:15.473410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 15:02:15.473410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 15:02:15.473410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 15:02:15.473410 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 15:02:15.474833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 15:02:15.474833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 15:02:15.474833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 15:02:15.474833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 15:02:15.474833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 15:02:15.474833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 15:02:15.474833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 15:02:15.474833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26c1eb76-2063-4c0d-80a1-6c0d9baaace4 could not be found. Aug 18 15:02:15.474833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:15.474833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 15:02:15.474833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:15.474833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 15:02:15.474833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 15:02:15.474833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 15:02:15.474833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 15:02:15.474833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 15:02:15.474833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26c1eb76-2063-4c0d-80a1-6c0d9baaace4 could not be found. Aug 18 15:02:15.474833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:15.476287 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-baced5a9-ba84-4abd-b2ab-a0c18a364cf8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Returning 404 to user: Instance 26c1eb76-2063-4c0d-80a1-6c0d9baaace4 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 15:02:15.476287 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-baced5a9-ba84-4abd-b2ab-a0c18a364cf8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4" status: 404 len: 111 microversion: 2.1 time: 0.030368 Aug 18 15:02:15.476287 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 834/1096] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:15 2022] GET /compute/v2.1/servers/26c1eb76-2063-4c0d-80a1-6c0d9baaace4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 15:02:15.901710 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5a65c7e8-8275-4658-88a6-9313c6e8b8c8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:15.902210 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-5a65c7e8-8275-4658-88a6-9313c6e8b8c8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:15.908088 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5a65c7e8-8275-4658-88a6-9313c6e8b8c8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:15.908569 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5a65c7e8-8275-4658-88a6-9313c6e8b8c8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:15.908999 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5a65c7e8-8275-4658-88a6-9313c6e8b8c8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:15.909682 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5a65c7e8-8275-4658-88a6-9313c6e8b8c8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:15.910132 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5a65c7e8-8275-4658-88a6-9313c6e8b8c8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:15.910551 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5a65c7e8-8275-4658-88a6-9313c6e8b8c8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:15.924055 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-5a65c7e8-8275-4658-88a6-9313c6e8b8c8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] HTTP exception thrown: Instance 80e04f79-c52c-4c8e-be85-d3beb6146729 could not be found. Aug 18 15:02:15.925592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5a65c7e8-8275-4658-88a6-9313c6e8b8c8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Request method failure captured: Aug 18 15:02:15.925592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: DELETE /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 HTTP/1.1 Aug 18 15:02:15.925592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 15:02:15.925592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 15:02:15.925592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 15:02:15.925592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 15:02:15.925592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 15:02:15.925592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 15:02:15.925592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 15:02:15.925592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 15:02:15.925592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lJfb-SS07HrKZYcnm0G93u-17_L-cy6H6p9IUQ5JWnD4JLMgxjRx4rRInyQZrAiQOqhb0KlPc-b92LLcz2UnJSsIwaEdO77sQZtc5L3bkSGa-hFFeGrk6WjrVOdYdqjIrq30lNVSwhOovQUG0gHU-XEiaYHlZ9LXcGO3leSj93R1rc Aug 18 15:02:15.925592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 15:02:15.925592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 15:02:15.925592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 15:02:15.925592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 15:02:15.925592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 15:02:15.925592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 15:02:15.925592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: d334ad6bd6194604a61ce4ca95149993 Aug 18 15:02:15.925592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-TestVolumeBootPattern-1402032980 Aug 18 15:02:15.925592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 15:02:15.925592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 15:02:15.927268 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d334ad6bd6194604a61ce4ca95149993"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d334ad6bd6194604a61ce4ca95149993"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d334ad6bd6194604a61ce4ca95149993", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d334ad6bd6194604a61ce4ca95149993"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 15:02:15.927268 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-TestVolumeBootPattern-1402032980 Aug 18 15:02:15.927268 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: d334ad6bd6194604a61ce4ca95149993 Aug 18 15:02:15.927268 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-TestVolumeBootPattern-1402032980 Aug 18 15:02:15.927268 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-TestVolumeBootPattern-1402032980-project Aug 18 15:02:15.927268 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 15:02:15.927268 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 15:02:15.927268 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: ac4d918f549c41d3ae19e80cecefa95c Aug 18 15:02:15.927268 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-TestVolumeBootPattern-1402032980-project Aug 18 15:02:15.927268 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 15:02:15.927268 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 80e04f79-c52c-4c8e-be85-d3beb6146729 could not be found. Aug 18 15:02:15.927268 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '80e04f79-c52c-4c8e-be85-d3beb6146729'} Aug 18 15:02:15.928244 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 15:02:15.928244 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 15:02:15.928244 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 15:02:15.928244 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 15:02:15.928244 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 15:02:15.928244 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 15:02:15.928244 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 15:02:15.928244 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 15:02:15.928244 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 15:02:15.928244 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 15:02:15.928244 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80e04f79-c52c-4c8e-be85-d3beb6146729 could not be found. Aug 18 15:02:15.928244 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:15.928244 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 15:02:15.928244 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:15.928244 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 15:02:15.928244 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 15:02:15.928244 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 15:02:15.928244 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 15:02:15.928244 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 15:02:15.928244 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 15:02:15.929868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 15:02:15.929868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 15:02:15.929868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 15:02:15.929868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 15:02:15.929868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 15:02:15.929868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 15:02:15.929868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 15:02:15.929868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 15:02:15.929868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 15:02:15.929868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80e04f79-c52c-4c8e-be85-d3beb6146729 could not be found. Aug 18 15:02:15.929868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:15.929868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 15:02:15.929868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:15.929868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 15:02:15.929868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 15:02:15.929868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 15:02:15.929868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 15:02:15.929868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 15:02:15.929868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80e04f79-c52c-4c8e-be85-d3beb6146729 could not be found. Aug 18 15:02:15.929868 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:15.931885 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5a65c7e8-8275-4658-88a6-9313c6e8b8c8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Returning 404 to user: Instance 80e04f79-c52c-4c8e-be85-d3beb6146729 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 15:02:15.931885 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-5a65c7e8-8275-4658-88a6-9313c6e8b8c8 tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "DELETE /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 404 len: 111 microversion: 2.1 time: 0.029141 Aug 18 15:02:15.931885 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 835/1097] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 15:02:15 2022] DELETE /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 15:02:15.936536 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-643162a5-17f1-4c02-97d0-5136db28a0bb tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:15.937230 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-643162a5-17f1-4c02-97d0-5136db28a0bb tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] [instance: 80e04f79-c52c-4c8e-be85-d3beb6146729] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:15.943217 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-643162a5-17f1-4c02-97d0-5136db28a0bb tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:15.943745 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-643162a5-17f1-4c02-97d0-5136db28a0bb tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:15.944179 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-643162a5-17f1-4c02-97d0-5136db28a0bb tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:15.944865 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-643162a5-17f1-4c02-97d0-5136db28a0bb tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:15.945343 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-643162a5-17f1-4c02-97d0-5136db28a0bb tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:15.945764 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-643162a5-17f1-4c02-97d0-5136db28a0bb tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:15.959629 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-643162a5-17f1-4c02-97d0-5136db28a0bb tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] HTTP exception thrown: Instance 80e04f79-c52c-4c8e-be85-d3beb6146729 could not be found. Aug 18 15:02:15.961164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-643162a5-17f1-4c02-97d0-5136db28a0bb tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Request method failure captured: Aug 18 15:02:15.961164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 HTTP/1.1 Aug 18 15:02:15.961164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 15:02:15.961164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 15:02:15.961164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 15:02:15.961164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 15:02:15.961164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 15:02:15.961164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 15:02:15.961164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 15:02:15.961164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 15:02:15.961164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lJfb-SS07HrKZYcnm0G93u-17_L-cy6H6p9IUQ5JWnD4JLMgxjRx4rRInyQZrAiQOqhb0KlPc-b92LLcz2UnJSsIwaEdO77sQZtc5L3bkSGa-hFFeGrk6WjrVOdYdqjIrq30lNVSwhOovQUG0gHU-XEiaYHlZ9LXcGO3leSj93R1rc Aug 18 15:02:15.961164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 15:02:15.961164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 15:02:15.961164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 15:02:15.961164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 15:02:15.961164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 15:02:15.961164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 15:02:15.961164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: d334ad6bd6194604a61ce4ca95149993 Aug 18 15:02:15.961164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-TestVolumeBootPattern-1402032980 Aug 18 15:02:15.961164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 15:02:15.961164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 15:02:15.962785 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d334ad6bd6194604a61ce4ca95149993"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d334ad6bd6194604a61ce4ca95149993"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d334ad6bd6194604a61ce4ca95149993", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d334ad6bd6194604a61ce4ca95149993"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 15:02:15.962785 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-TestVolumeBootPattern-1402032980 Aug 18 15:02:15.962785 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: d334ad6bd6194604a61ce4ca95149993 Aug 18 15:02:15.962785 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-TestVolumeBootPattern-1402032980 Aug 18 15:02:15.962785 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-TestVolumeBootPattern-1402032980-project Aug 18 15:02:15.962785 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 15:02:15.962785 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 15:02:15.962785 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: ac4d918f549c41d3ae19e80cecefa95c Aug 18 15:02:15.962785 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-TestVolumeBootPattern-1402032980-project Aug 18 15:02:15.962785 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 15:02:15.962785 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 80e04f79-c52c-4c8e-be85-d3beb6146729 could not be found. Aug 18 15:02:15.962785 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '80e04f79-c52c-4c8e-be85-d3beb6146729'} Aug 18 15:02:15.963886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 15:02:15.963886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 15:02:15.963886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 15:02:15.963886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 15:02:15.963886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 15:02:15.963886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 15:02:15.963886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 15:02:15.963886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 15:02:15.963886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 15:02:15.963886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 15:02:15.963886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80e04f79-c52c-4c8e-be85-d3beb6146729 could not be found. Aug 18 15:02:15.963886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:15.963886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 15:02:15.963886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:15.963886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 15:02:15.963886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 15:02:15.963886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 15:02:15.963886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 15:02:15.963886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 15:02:15.963886 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 15:02:15.965378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 15:02:15.965378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 15:02:15.965378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 15:02:15.965378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 15:02:15.965378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 15:02:15.965378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 15:02:15.965378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 15:02:15.965378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80e04f79-c52c-4c8e-be85-d3beb6146729 could not be found. Aug 18 15:02:15.965378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:15.965378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 15:02:15.965378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:15.965378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 15:02:15.965378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 15:02:15.965378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 15:02:15.965378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 15:02:15.965378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 15:02:15.965378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80e04f79-c52c-4c8e-be85-d3beb6146729 could not be found. Aug 18 15:02:15.965378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:15.967110 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-643162a5-17f1-4c02-97d0-5136db28a0bb tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Returning 404 to user: Instance 80e04f79-c52c-4c8e-be85-d3beb6146729 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 15:02:15.967110 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-643162a5-17f1-4c02-97d0-5136db28a0bb tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729" status: 404 len: 111 microversion: 2.1 time: 0.030236 Aug 18 15:02:15.967110 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 836/1098] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:15 2022] GET /compute/v2.1/servers/80e04f79-c52c-4c8e-be85-d3beb6146729 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 15:02:17.263752 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b03b5ca8-f86a-45c9-b8e0-8b985a7e5ace tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] Calling method '.version_select at 0x7fb217a76b80>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:17.283248 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b03b5ca8-f86a-45c9-b8e0-8b985a7e5ace tempest-TestVolumeBootPattern-1402032980 tempest-TestVolumeBootPattern-1402032980-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-198073082" status: 202 len: 0 microversion: 2.1 time: 0.023394 Aug 18 15:02:17.283909 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 837/1099] 10.222.0.36 () {58 vars in 1260 bytes} [Thu Aug 18 15:02:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-198073082 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 15:02:36.782498 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 15:02:36.783383 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 15:02:36.787401 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-a02fc13d-ff42-4646-b14a-8a9cc8da483b tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:02:36.787990 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-a02fc13d-ff42-4646-b14a-8a9cc8da483b tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:36.796687 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a02fc13d-ff42-4646-b14a-8a9cc8da483b tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:36.797178 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a02fc13d-ff42-4646-b14a-8a9cc8da483b tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:36.797604 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a02fc13d-ff42-4646-b14a-8a9cc8da483b tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:36.798303 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a02fc13d-ff42-4646-b14a-8a9cc8da483b tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:36.798754 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a02fc13d-ff42-4646-b14a-8a9cc8da483b tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:36.799174 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-a02fc13d-ff42-4646-b14a-8a9cc8da483b tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:36.826831 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.objects.instance [None req-a02fc13d-ff42-4646-b14a-8a9cc8da483b tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lazy-loading 'flavor' on Instance uuid 40cbcd5e-57d5-4177-8358-32279c6770d6 {{(pid=132268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 15:02:36.904634 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-a02fc13d-ff42-4646-b14a-8a9cc8da483b tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "POST /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6/action" status: 202 len: 0 microversion: 2.1 time: 0.123617 Aug 18 15:02:36.905321 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 838/1100] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Aug 18 15:02:36 2022] POST /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 15:02:36.913876 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2f30a466-7479-4d73-9023-b99a1ea6f448 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:36.914591 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2f30a466-7479-4d73-9023-b99a1ea6f448 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:36.922245 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2f30a466-7479-4d73-9023-b99a1ea6f448 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:36.922988 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2f30a466-7479-4d73-9023-b99a1ea6f448 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:36.923821 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2f30a466-7479-4d73-9023-b99a1ea6f448 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:36.925076 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2f30a466-7479-4d73-9023-b99a1ea6f448 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:36.925926 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2f30a466-7479-4d73-9023-b99a1ea6f448 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:36.926657 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2f30a466-7479-4d73-9023-b99a1ea6f448 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:37.077340 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2f30a466-7479-4d73-9023-b99a1ea6f448 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:37.085360 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2f30a466-7479-4d73-9023-b99a1ea6f448 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1566 microversion: 2.1 time: 0.175557 Aug 18 15:02:37.085931 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 839/1101] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:36 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:02:38.106958 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-52a21445-68e1-43d8-a09c-2812b8464e49 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:38.107608 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-52a21445-68e1-43d8-a09c-2812b8464e49 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:38.114309 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-52a21445-68e1-43d8-a09c-2812b8464e49 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:38.114797 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-52a21445-68e1-43d8-a09c-2812b8464e49 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:38.115234 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-52a21445-68e1-43d8-a09c-2812b8464e49 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:38.115953 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-52a21445-68e1-43d8-a09c-2812b8464e49 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:38.116412 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-52a21445-68e1-43d8-a09c-2812b8464e49 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:38.116838 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-52a21445-68e1-43d8-a09c-2812b8464e49 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:38.256460 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-52a21445-68e1-43d8-a09c-2812b8464e49 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:38.264535 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-52a21445-68e1-43d8-a09c-2812b8464e49 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1566 microversion: 2.1 time: 0.162052 Aug 18 15:02:38.265363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 840/1102] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:38 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:02:38.728503 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-69f21c81-9801-4d86-8edb-0c475f1bfd25 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-530573814"}} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:02:38.729609 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-69f21c81-9801-4d86-8edb-0c475f1bfd25 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:38.736222 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-69f21c81-9801-4d86-8edb-0c475f1bfd25 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:38.736705 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-69f21c81-9801-4d86-8edb-0c475f1bfd25 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:38.737145 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-69f21c81-9801-4d86-8edb-0c475f1bfd25 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:38.737853 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-69f21c81-9801-4d86-8edb-0c475f1bfd25 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:38.738270 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-69f21c81-9801-4d86-8edb-0c475f1bfd25 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:38.738682 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-69f21c81-9801-4d86-8edb-0c475f1bfd25 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:38.964397 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.network.security_group_api [None req-69f21c81-9801-4d86-8edb-0c475f1bfd25 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Removing security group 09bea26e-6c62-4406-aaa8-4f8c3695fdda from port 5b6ea491-2ec5-4942-b0d0-9fb2a0d66e5c Aug 18 15:02:39.479435 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-69f21c81-9801-4d86-8edb-0c475f1bfd25 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "POST /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc/action" status: 202 len: 0 microversion: 2.1 time: 0.754322 Aug 18 15:02:39.484400 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 841/1103] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Aug 18 15:02:38 2022] POST /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc/action => generated 0 bytes in 760 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 15:02:39.489093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-31f850cc-43e6-47d5-b68b-148c3fd830b2 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:39.490543 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-31f850cc-43e6-47d5-b68b-148c3fd830b2 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:39.498790 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-31f850cc-43e6-47d5-b68b-148c3fd830b2 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:39.499278 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-31f850cc-43e6-47d5-b68b-148c3fd830b2 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:39.499816 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-31f850cc-43e6-47d5-b68b-148c3fd830b2 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:39.500637 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-31f850cc-43e6-47d5-b68b-148c3fd830b2 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:39.507947 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-31f850cc-43e6-47d5-b68b-148c3fd830b2 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:39.509135 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-31f850cc-43e6-47d5-b68b-148c3fd830b2 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:39.699616 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-31f850cc-43e6-47d5-b68b-148c3fd830b2 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:39.707908 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-31f850cc-43e6-47d5-b68b-148c3fd830b2 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1566 microversion: 2.1 time: 0.222521 Aug 18 15:02:39.708796 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 842/1104] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:39 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1566 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 15:02:39.948318 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-0c569302-7e53-46cd-91e8-516c2a7678e7 req-8e0c5e05-0725-4e2c-92a4-fce80880dc84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28033011-8251-4306-907d-9c3215269bfc", "tag": "5b6ea491-2ec5-4942-b0d0-9fb2a0d66e5c"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:02:39.958233 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-0c569302-7e53-46cd-91e8-516c2a7678e7 req-8e0c5e05-0725-4e2c-92a4-fce80880dc84 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:39.958704 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-0c569302-7e53-46cd-91e8-516c2a7678e7 req-8e0c5e05-0725-4e2c-92a4-fce80880dc84 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:39.959185 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-0c569302-7e53-46cd-91e8-516c2a7678e7 req-8e0c5e05-0725-4e2c-92a4-fce80880dc84 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:39.973984 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-0c569302-7e53-46cd-91e8-516c2a7678e7 req-8e0c5e05-0725-4e2c-92a4-fce80880dc84 service nova] Creating event network-changed:5b6ea491-2ec5-4942-b0d0-9fb2a0d66e5c for instance 28033011-8251-4306-907d-9c3215269bfc on hv-cinder-85220 Aug 18 15:02:39.981185 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-0c569302-7e53-46cd-91e8-516c2a7678e7 req-8e0c5e05-0725-4e2c-92a4-fce80880dc84 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.270745 Aug 18 15:02:39.987832 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 843/1105] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 15:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 15:02:40.731943 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-1abd6813-42ed-4106-9a5c-070dcb0aefa0 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:40.732564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-1abd6813-42ed-4106-9a5c-070dcb0aefa0 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:40.740041 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1abd6813-42ed-4106-9a5c-070dcb0aefa0 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:40.740514 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1abd6813-42ed-4106-9a5c-070dcb0aefa0 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:40.740937 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1abd6813-42ed-4106-9a5c-070dcb0aefa0 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:40.741632 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1abd6813-42ed-4106-9a5c-070dcb0aefa0 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:40.742077 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1abd6813-42ed-4106-9a5c-070dcb0aefa0 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:40.742492 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1abd6813-42ed-4106-9a5c-070dcb0aefa0 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:41.107044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-1abd6813-42ed-4106-9a5c-070dcb0aefa0 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:41.114906 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-1abd6813-42ed-4106-9a5c-070dcb0aefa0 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1566 microversion: 2.1 time: 0.388123 Aug 18 15:02:41.115472 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 844/1106] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:40 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1566 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:02:41.419124 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0f874e3a-8783-4164-8dad-071455b86aa4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:41.419706 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0f874e3a-8783-4164-8dad-071455b86aa4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:41.426448 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0f874e3a-8783-4164-8dad-071455b86aa4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:41.427094 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0f874e3a-8783-4164-8dad-071455b86aa4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:41.427649 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0f874e3a-8783-4164-8dad-071455b86aa4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:41.428516 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0f874e3a-8783-4164-8dad-071455b86aa4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:41.429072 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0f874e3a-8783-4164-8dad-071455b86aa4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:41.429626 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0f874e3a-8783-4164-8dad-071455b86aa4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:41.529856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.objects.instance [None req-0f874e3a-8783-4164-8dad-071455b86aa4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lazy-loading 'services' on Instance uuid 28033011-8251-4306-907d-9c3215269bfc {{(pid=132268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 15:02:41.629274 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0f874e3a-8783-4164-8dad-071455b86aa4 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "DELETE /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc/os-volume_attachments/0c936d00-39dc-4a3c-bb2e-f10aaacb6630" status: 202 len: 0 microversion: 2.1 time: 0.214805 Aug 18 15:02:41.630227 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 845/1107] 10.222.0.36 () {58 vars in 1416 bytes} [Thu Aug 18 15:02:41 2022] DELETE /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc/os-volume_attachments/0c936d00-39dc-4a3c-bb2e-f10aaacb6630 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 15:02:41.639096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-26e13f37-4f13-4a71-aeb0-5c66aaa4be78 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:41.641657 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-26e13f37-4f13-4a71-aeb0-5c66aaa4be78 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:41.648737 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26e13f37-4f13-4a71-aeb0-5c66aaa4be78 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:41.649225 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26e13f37-4f13-4a71-aeb0-5c66aaa4be78 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:41.649656 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26e13f37-4f13-4a71-aeb0-5c66aaa4be78 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:41.651147 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26e13f37-4f13-4a71-aeb0-5c66aaa4be78 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:41.651394 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26e13f37-4f13-4a71-aeb0-5c66aaa4be78 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:41.651910 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-26e13f37-4f13-4a71-aeb0-5c66aaa4be78 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:41.844320 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-26e13f37-4f13-4a71-aeb0-5c66aaa4be78 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.209493 Aug 18 15:02:41.845383 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 846/1108] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Aug 18 15:02:41 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 15:02:41.996927 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-9b2c15c7-2926-41c5-8392-7b524006ec3f req-3d93c52c-422c-4a13-a6b3-7d43a9e7ed36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28033011-8251-4306-907d-9c3215269bfc", "tag": "5b6ea491-2ec5-4942-b0d0-9fb2a0d66e5c"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:02:42.006296 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-9b2c15c7-2926-41c5-8392-7b524006ec3f req-3d93c52c-422c-4a13-a6b3-7d43a9e7ed36 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:42.006783 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-9b2c15c7-2926-41c5-8392-7b524006ec3f req-3d93c52c-422c-4a13-a6b3-7d43a9e7ed36 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:42.007265 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-9b2c15c7-2926-41c5-8392-7b524006ec3f req-3d93c52c-422c-4a13-a6b3-7d43a9e7ed36 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:42.019174 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-9b2c15c7-2926-41c5-8392-7b524006ec3f req-3d93c52c-422c-4a13-a6b3-7d43a9e7ed36 service nova] Creating event network-changed:5b6ea491-2ec5-4942-b0d0-9fb2a0d66e5c for instance 28033011-8251-4306-907d-9c3215269bfc on hv-cinder-85220 Aug 18 15:02:42.024151 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-9b2c15c7-2926-41c5-8392-7b524006ec3f req-3d93c52c-422c-4a13-a6b3-7d43a9e7ed36 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030978 Aug 18 15:02:42.024742 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 847/1109] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 15:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 15:02:42.138898 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-4605534f-feb1-44eb-88f0-d5e3fe69cff8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:42.139606 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-4605534f-feb1-44eb-88f0-d5e3fe69cff8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:42.146528 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4605534f-feb1-44eb-88f0-d5e3fe69cff8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:42.146943 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4605534f-feb1-44eb-88f0-d5e3fe69cff8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:42.147385 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4605534f-feb1-44eb-88f0-d5e3fe69cff8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:42.149159 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4605534f-feb1-44eb-88f0-d5e3fe69cff8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:42.149159 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4605534f-feb1-44eb-88f0-d5e3fe69cff8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:42.149159 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4605534f-feb1-44eb-88f0-d5e3fe69cff8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:42.343377 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-4605534f-feb1-44eb-88f0-d5e3fe69cff8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:42.355847 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-4605534f-feb1-44eb-88f0-d5e3fe69cff8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1566 microversion: 2.1 time: 0.221277 Aug 18 15:02:42.356770 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 848/1110] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:42 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1566 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:02:42.860707 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-dda6cf29-fd26-4a99-a57d-c9d4d6722705 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:42.862922 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-dda6cf29-fd26-4a99-a57d-c9d4d6722705 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:42.870269 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dda6cf29-fd26-4a99-a57d-c9d4d6722705 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:42.870757 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dda6cf29-fd26-4a99-a57d-c9d4d6722705 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:42.871185 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dda6cf29-fd26-4a99-a57d-c9d4d6722705 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:42.871912 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dda6cf29-fd26-4a99-a57d-c9d4d6722705 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:42.872374 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dda6cf29-fd26-4a99-a57d-c9d4d6722705 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:42.872796 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dda6cf29-fd26-4a99-a57d-c9d4d6722705 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:42.904638 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-dda6cf29-fd26-4a99-a57d-c9d4d6722705 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050623 Aug 18 15:02:42.905201 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 849/1111] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Aug 18 15:02:42 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 15:02:42.916819 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-db1d9bb2-5478-445c-9ae6-15579490d2b9 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:42.917319 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-db1d9bb2-5478-445c-9ae6-15579490d2b9 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:42.933225 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-db1d9bb2-5478-445c-9ae6-15579490d2b9 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:42.933850 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-db1d9bb2-5478-445c-9ae6-15579490d2b9 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:42.934728 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-db1d9bb2-5478-445c-9ae6-15579490d2b9 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:42.935660 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-db1d9bb2-5478-445c-9ae6-15579490d2b9 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:42.936837 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-db1d9bb2-5478-445c-9ae6-15579490d2b9 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:42.937541 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-db1d9bb2-5478-445c-9ae6-15579490d2b9 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:43.015186 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-db1d9bb2-5478-445c-9ae6-15579490d2b9 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] HTTP exception thrown: Instance 28033011-8251-4306-907d-9c3215269bfc is not attached to volume 0c936d00-39dc-4a3c-bb2e-f10aaacb6630 Aug 18 15:02:43.017605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-db1d9bb2-5478-445c-9ae6-15579490d2b9 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Request method failure captured: Aug 18 15:02:43.017605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: DELETE /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc/os-volume_attachments/0c936d00-39dc-4a3c-bb2e-f10aaacb6630 HTTP/1.1 Aug 18 15:02:43.017605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 15:02:43.017605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 15:02:43.017605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 15:02:43.017605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 15:02:43.017605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 15:02:43.017605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 15:02:43.017605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 15:02:43.017605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 15:02:43.017605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lQcnRHxakiWn7EL29xbR3vr-08PfsOihB_Z1lt7fCgLFLz6kJCvIWo8CT9gdz1ZHLxenTk5Yle0v_xZaNRjHR2h90ckLoma6FppRrwGpuyAbjSQtsuyN0BKlG91EDA8c0lk0EwXL0XbTCDpHwCQmJvMtzzeDW1sn26vLVFQrYKFx9Q Aug 18 15:02:43.017605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 15:02:43.017605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 15:02:43.017605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 15:02:43.017605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 15:02:43.017605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 15:02:43.017605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 15:02:43.017605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: 1f169db98a4549109d83c18d108b8282 Aug 18 15:02:43.017605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-TestMinimumBasicScenario-1128546019 Aug 18 15:02:43.017605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 15:02:43.017605 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 15:02:43.020802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1f169db98a4549109d83c18d108b8282"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1f169db98a4549109d83c18d108b8282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1f169db98a4549109d83c18d108b8282", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1f169db98a4549109d83c18d108b8282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 15:02:43.020802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-TestMinimumBasicScenario-1128546019 Aug 18 15:02:43.020802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: 1f169db98a4549109d83c18d108b8282 Aug 18 15:02:43.020802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1128546019 Aug 18 15:02:43.020802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-TestMinimumBasicScenario-1128546019-project Aug 18 15:02:43.020802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 15:02:43.020802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 15:02:43.020802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 57632501742348109ed397d84c71510a Aug 18 15:02:43.020802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-TestMinimumBasicScenario-1128546019-project Aug 18 15:02:43.020802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 15:02:43.020802 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 28033011-8251-4306-907d-9c3215269bfc is not attached to volume 0c936d00-39dc-4a3c-bb2e-f10aaacb6630 Aug 18 15:02:43.022482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'server_id': '28033011-8251-4306-907d-9c3215269bfc', 'id': '0c936d00-39dc-4a3c-bb2e-f10aaacb6630'} Aug 18 15:02:43.022482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 15:02:43.022482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 15:02:43.022482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 18 15:02:43.022482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 18 15:02:43.022482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 15:02:43.022482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 15:02:43.022482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 18 15:02:43.022482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 18 15:02:43.022482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0c936d00-39dc-4a3c-bb2e-f10aaacb6630. Aug 18 15:02:43.022482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:43.022482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 15:02:43.022482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:43.022482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 15:02:43.022482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 15:02:43.022482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 15:02:43.022482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 15:02:43.022482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 15:02:43.022482 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 15:02:43.025292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 15:02:43.025292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 18 15:02:43.025292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 18 15:02:43.025292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28033011-8251-4306-907d-9c3215269bfc is not attached to volume 0c936d00-39dc-4a3c-bb2e-f10aaacb6630 Aug 18 15:02:43.025292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:43.025292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 15:02:43.025292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:43.025292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 15:02:43.025292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 15:02:43.025292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 15:02:43.025292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 15:02:43.025292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 15:02:43.025292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28033011-8251-4306-907d-9c3215269bfc is not attached to volume 0c936d00-39dc-4a3c-bb2e-f10aaacb6630 Aug 18 15:02:43.025292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:43.025292 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-db1d9bb2-5478-445c-9ae6-15579490d2b9 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Returning 404 to user: Instance 28033011-8251-4306-907d-9c3215269bfc is not attached to volume 0c936d00-39dc-4a3c-bb2e-f10aaacb6630 {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 15:02:43.028073 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-db1d9bb2-5478-445c-9ae6-15579490d2b9 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "DELETE /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc/os-volume_attachments/0c936d00-39dc-4a3c-bb2e-f10aaacb6630" status: 404 len: 154 microversion: 2.1 time: 0.107622 Aug 18 15:02:43.028073 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 850/1112] 10.222.0.36 () {58 vars in 1416 bytes} [Thu Aug 18 15:02:42 2022] DELETE /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc/os-volume_attachments/0c936d00-39dc-4a3c-bb2e-f10aaacb6630 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 15:02:43.380897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-6bce7982-7b50-4710-a9c4-f696cff1bc82 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:43.381756 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-6bce7982-7b50-4710-a9c4-f696cff1bc82 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:43.390283 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6bce7982-7b50-4710-a9c4-f696cff1bc82 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:43.390771 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6bce7982-7b50-4710-a9c4-f696cff1bc82 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:43.391206 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6bce7982-7b50-4710-a9c4-f696cff1bc82 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:43.392008 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6bce7982-7b50-4710-a9c4-f696cff1bc82 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:43.392468 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6bce7982-7b50-4710-a9c4-f696cff1bc82 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:43.392897 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6bce7982-7b50-4710-a9c4-f696cff1bc82 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:43.531377 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6bce7982-7b50-4710-a9c4-f696cff1bc82 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:43.539256 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-6bce7982-7b50-4710-a9c4-f696cff1bc82 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1566 microversion: 2.1 time: 0.164193 Aug 18 15:02:43.539838 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 851/1113] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:43 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:02:44.163648 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-919e0657-b2da-4015-b214-fe07c6f72373 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:44.164257 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-919e0657-b2da-4015-b214-fe07c6f72373 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:44.171191 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-919e0657-b2da-4015-b214-fe07c6f72373 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:44.171691 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-919e0657-b2da-4015-b214-fe07c6f72373 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:44.172141 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-919e0657-b2da-4015-b214-fe07c6f72373 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:44.172831 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-919e0657-b2da-4015-b214-fe07c6f72373 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:44.173287 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-919e0657-b2da-4015-b214-fe07c6f72373 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:44.173716 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-919e0657-b2da-4015-b214-fe07c6f72373 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:44.204173 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-919e0657-b2da-4015-b214-fe07c6f72373 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Going to try to terminate instance {{(pid=132268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 15:02:44.232412 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 15:02:44.283266 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-919e0657-b2da-4015-b214-fe07c6f72373 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "DELETE /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 204 len: 0 microversion: 2.1 time: 0.122798 Aug 18 15:02:44.284336 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 852/1114] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 15:02:44 2022] DELETE /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 15:02:44.295311 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e797d9a8-c532-4e9d-ae0d-e9390e3eea77 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:44.296095 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e797d9a8-c532-4e9d-ae0d-e9390e3eea77 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:44.302092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e797d9a8-c532-4e9d-ae0d-e9390e3eea77 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:44.302575 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e797d9a8-c532-4e9d-ae0d-e9390e3eea77 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:44.303007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e797d9a8-c532-4e9d-ae0d-e9390e3eea77 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:44.303720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e797d9a8-c532-4e9d-ae0d-e9390e3eea77 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:44.304176 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e797d9a8-c532-4e9d-ae0d-e9390e3eea77 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:44.304597 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e797d9a8-c532-4e9d-ae0d-e9390e3eea77 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:44.438944 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e797d9a8-c532-4e9d-ae0d-e9390e3eea77 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:44.447114 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e797d9a8-c532-4e9d-ae0d-e9390e3eea77 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1554 microversion: 2.1 time: 0.157628 Aug 18 15:02:44.447719 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 853/1115] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:44 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:02:44.560053 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-74b15371-f035-45e9-8a21-277ebfbff771 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:44.560758 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-74b15371-f035-45e9-8a21-277ebfbff771 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:44.566862 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74b15371-f035-45e9-8a21-277ebfbff771 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:44.567344 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74b15371-f035-45e9-8a21-277ebfbff771 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:44.567822 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74b15371-f035-45e9-8a21-277ebfbff771 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:44.568505 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74b15371-f035-45e9-8a21-277ebfbff771 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:44.568957 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74b15371-f035-45e9-8a21-277ebfbff771 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:44.569378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-74b15371-f035-45e9-8a21-277ebfbff771 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:44.706002 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-74b15371-f035-45e9-8a21-277ebfbff771 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:44.714379 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-74b15371-f035-45e9-8a21-277ebfbff771 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1566 microversion: 2.1 time: 0.158511 Aug 18 15:02:44.714939 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 854/1116] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:44 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:02:45.468430 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ce1c9d9d-baf1-427e-9207-f04e9d05cf1f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:45.469373 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ce1c9d9d-baf1-427e-9207-f04e9d05cf1f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:45.475495 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ce1c9d9d-baf1-427e-9207-f04e9d05cf1f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:45.476014 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ce1c9d9d-baf1-427e-9207-f04e9d05cf1f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:45.476451 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ce1c9d9d-baf1-427e-9207-f04e9d05cf1f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:45.477149 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ce1c9d9d-baf1-427e-9207-f04e9d05cf1f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:45.477606 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ce1c9d9d-baf1-427e-9207-f04e9d05cf1f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:45.478035 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ce1c9d9d-baf1-427e-9207-f04e9d05cf1f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:45.611444 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ce1c9d9d-baf1-427e-9207-f04e9d05cf1f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:45.619318 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-ce1c9d9d-baf1-427e-9207-f04e9d05cf1f tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1554 microversion: 2.1 time: 0.154920 Aug 18 15:02:45.619910 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 855/1117] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:45 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:02:45.736111 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-83ddc971-8662-4a8b-95d3-5d696b79b5a9 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:45.736638 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-83ddc971-8662-4a8b-95d3-5d696b79b5a9 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:45.743362 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-83ddc971-8662-4a8b-95d3-5d696b79b5a9 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:45.743882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-83ddc971-8662-4a8b-95d3-5d696b79b5a9 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:45.744315 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-83ddc971-8662-4a8b-95d3-5d696b79b5a9 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:45.745003 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-83ddc971-8662-4a8b-95d3-5d696b79b5a9 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:45.745457 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-83ddc971-8662-4a8b-95d3-5d696b79b5a9 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:45.745882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-83ddc971-8662-4a8b-95d3-5d696b79b5a9 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:45.879798 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-83ddc971-8662-4a8b-95d3-5d696b79b5a9 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:45.887928 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-83ddc971-8662-4a8b-95d3-5d696b79b5a9 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1566 microversion: 2.1 time: 0.156075 Aug 18 15:02:45.888620 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 856/1118] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:45 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:02:46.641311 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-f244344f-f058-495e-9681-fb22fc7285a0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:46.642299 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-f244344f-f058-495e-9681-fb22fc7285a0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:46.648444 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f244344f-f058-495e-9681-fb22fc7285a0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:46.648929 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f244344f-f058-495e-9681-fb22fc7285a0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:46.649371 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f244344f-f058-495e-9681-fb22fc7285a0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:46.650075 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f244344f-f058-495e-9681-fb22fc7285a0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:46.650540 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f244344f-f058-495e-9681-fb22fc7285a0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:46.650963 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-f244344f-f058-495e-9681-fb22fc7285a0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:46.865600 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-f244344f-f058-495e-9681-fb22fc7285a0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57632501742348109ed397d84c71510a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f169db98a4549109d83c18d108b8282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:46.875626 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-f244344f-f058-495e-9681-fb22fc7285a0 tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 200 len: 1554 microversion: 2.1 time: 0.238434 Aug 18 15:02:46.876247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 857/1119] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:46 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 1554 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:02:46.912793 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-34d0de24-d3e7-4200-ad4d-a0ebbedc9a09 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:46.913614 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-34d0de24-d3e7-4200-ad4d-a0ebbedc9a09 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:46.925085 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-34d0de24-d3e7-4200-ad4d-a0ebbedc9a09 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:46.925703 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-34d0de24-d3e7-4200-ad4d-a0ebbedc9a09 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:46.926376 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-34d0de24-d3e7-4200-ad4d-a0ebbedc9a09 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:46.927167 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-34d0de24-d3e7-4200-ad4d-a0ebbedc9a09 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:46.927626 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-34d0de24-d3e7-4200-ad4d-a0ebbedc9a09 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:46.928114 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-34d0de24-d3e7-4200-ad4d-a0ebbedc9a09 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:47.100423 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-34d0de24-d3e7-4200-ad4d-a0ebbedc9a09 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:47.110682 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-34d0de24-d3e7-4200-ad4d-a0ebbedc9a09 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1566 microversion: 2.1 time: 0.204399 Aug 18 15:02:47.111367 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 858/1120] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:46 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1566 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 15:02:47.116012 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-6bff60f7-7b95-462b-8ccf-65fcfd9c706e req-15acf967-1803-4ca2-b5b8-a26e6d73982b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28033011-8251-4306-907d-9c3215269bfc", "name": "network-vif-deleted", "tag": "5b6ea491-2ec5-4942-b0d0-9fb2a0d66e5c"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:02:47.126760 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-6bff60f7-7b95-462b-8ccf-65fcfd9c706e req-15acf967-1803-4ca2-b5b8-a26e6d73982b service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:47.127301 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-6bff60f7-7b95-462b-8ccf-65fcfd9c706e req-15acf967-1803-4ca2-b5b8-a26e6d73982b service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:47.127824 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-6bff60f7-7b95-462b-8ccf-65fcfd9c706e req-15acf967-1803-4ca2-b5b8-a26e6d73982b service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:47.141981 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-6bff60f7-7b95-462b-8ccf-65fcfd9c706e req-15acf967-1803-4ca2-b5b8-a26e6d73982b service nova] Creating event network-vif-deleted:5b6ea491-2ec5-4942-b0d0-9fb2a0d66e5c for instance 28033011-8251-4306-907d-9c3215269bfc on hv-cinder-85220 Aug 18 15:02:47.146720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-6bff60f7-7b95-462b-8ccf-65fcfd9c706e req-15acf967-1803-4ca2-b5b8-a26e6d73982b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034081 Aug 18 15:02:47.147307 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 859/1121] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 15:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 15:02:47.901761 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8d988e29-abe5-4a06-8b4e-c59497c7951a tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:47.902855 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-8d988e29-abe5-4a06-8b4e-c59497c7951a tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] [instance: 28033011-8251-4306-907d-9c3215269bfc] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:47.910252 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8d988e29-abe5-4a06-8b4e-c59497c7951a tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:47.910736 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8d988e29-abe5-4a06-8b4e-c59497c7951a tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:47.911157 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8d988e29-abe5-4a06-8b4e-c59497c7951a tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:47.912149 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8d988e29-abe5-4a06-8b4e-c59497c7951a tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:47.912596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8d988e29-abe5-4a06-8b4e-c59497c7951a tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:47.913010 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-8d988e29-abe5-4a06-8b4e-c59497c7951a tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:47.927148 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-8d988e29-abe5-4a06-8b4e-c59497c7951a tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] HTTP exception thrown: Instance 28033011-8251-4306-907d-9c3215269bfc could not be found. Aug 18 15:02:47.928856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8d988e29-abe5-4a06-8b4e-c59497c7951a tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Request method failure captured: Aug 18 15:02:47.928856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc HTTP/1.1 Aug 18 15:02:47.928856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 15:02:47.928856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 15:02:47.928856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 15:02:47.928856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 15:02:47.928856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 15:02:47.928856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 15:02:47.928856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 15:02:47.928856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 15:02:47.928856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lQcnRHxakiWn7EL29xbR3vr-08PfsOihB_Z1lt7fCgLFLz6kJCvIWo8CT9gdz1ZHLxenTk5Yle0v_xZaNRjHR2h90ckLoma6FppRrwGpuyAbjSQtsuyN0BKlG91EDA8c0lk0EwXL0XbTCDpHwCQmJvMtzzeDW1sn26vLVFQrYKFx9Q Aug 18 15:02:47.928856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 15:02:47.928856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 15:02:47.928856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 15:02:47.928856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 15:02:47.928856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 15:02:47.928856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 15:02:47.928856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: 1f169db98a4549109d83c18d108b8282 Aug 18 15:02:47.928856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-TestMinimumBasicScenario-1128546019 Aug 18 15:02:47.928856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 15:02:47.928856 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 15:02:47.930304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1f169db98a4549109d83c18d108b8282"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1f169db98a4549109d83c18d108b8282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1f169db98a4549109d83c18d108b8282", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1f169db98a4549109d83c18d108b8282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 15:02:47.930304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-TestMinimumBasicScenario-1128546019 Aug 18 15:02:47.930304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: 1f169db98a4549109d83c18d108b8282 Aug 18 15:02:47.930304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1128546019 Aug 18 15:02:47.930304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-TestMinimumBasicScenario-1128546019-project Aug 18 15:02:47.930304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 15:02:47.930304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 15:02:47.930304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 57632501742348109ed397d84c71510a Aug 18 15:02:47.930304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-TestMinimumBasicScenario-1128546019-project Aug 18 15:02:47.930304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 15:02:47.930304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 28033011-8251-4306-907d-9c3215269bfc could not be found. Aug 18 15:02:47.930304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '28033011-8251-4306-907d-9c3215269bfc'} Aug 18 15:02:47.934542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 15:02:47.934542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 15:02:47.934542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 15:02:47.934542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 15:02:47.934542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 15:02:47.934542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 15:02:47.934542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 15:02:47.934542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 15:02:47.934542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 15:02:47.934542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 15:02:47.934542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28033011-8251-4306-907d-9c3215269bfc could not be found. Aug 18 15:02:47.934542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:47.934542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 15:02:47.934542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:47.934542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 15:02:47.934542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 15:02:47.934542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 15:02:47.934542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 15:02:47.934542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 15:02:47.934542 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 15:02:47.936086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 15:02:47.936086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 15:02:47.936086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 15:02:47.936086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 15:02:47.936086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 15:02:47.936086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 15:02:47.936086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 15:02:47.936086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28033011-8251-4306-907d-9c3215269bfc could not be found. Aug 18 15:02:47.936086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:47.936086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 15:02:47.936086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:47.936086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 15:02:47.936086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 15:02:47.936086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 15:02:47.936086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 15:02:47.936086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 15:02:47.936086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28033011-8251-4306-907d-9c3215269bfc could not be found. Aug 18 15:02:47.936086 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:02:47.938147 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-8d988e29-abe5-4a06-8b4e-c59497c7951a tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Returning 404 to user: Instance 28033011-8251-4306-907d-9c3215269bfc could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 15:02:47.938147 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-8d988e29-abe5-4a06-8b4e-c59497c7951a tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc" status: 404 len: 111 microversion: 2.1 time: 0.034998 Aug 18 15:02:47.938147 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 860/1122] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:47 2022] GET /compute/v2.1/servers/28033011-8251-4306-907d-9c3215269bfc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 15:02:47.944182 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-6d760ad3-164c-4074-9db5-51e04a872b1b tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] Calling method '.version_select at 0x7fb20efcf5e0>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:47.968986 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-6d760ad3-164c-4074-9db5-51e04a872b1b tempest-TestMinimumBasicScenario-1128546019 tempest-TestMinimumBasicScenario-1128546019-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2113499146" status: 202 len: 0 microversion: 2.1 time: 0.032923 Aug 18 15:02:47.969941 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 861/1123] 10.222.0.36 () {58 vars in 1272 bytes} [Thu Aug 18 15:02:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2113499146 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 15:02:48.132757 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-1fd56239-aa6b-44fd-b45f-dfa7af71b443 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:48.133306 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-1fd56239-aa6b-44fd-b45f-dfa7af71b443 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:48.141437 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1fd56239-aa6b-44fd-b45f-dfa7af71b443 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:48.142103 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1fd56239-aa6b-44fd-b45f-dfa7af71b443 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:48.142552 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1fd56239-aa6b-44fd-b45f-dfa7af71b443 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:48.143259 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1fd56239-aa6b-44fd-b45f-dfa7af71b443 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:48.143743 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1fd56239-aa6b-44fd-b45f-dfa7af71b443 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:48.144202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1fd56239-aa6b-44fd-b45f-dfa7af71b443 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:48.293223 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-1fd56239-aa6b-44fd-b45f-dfa7af71b443 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:48.302050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-1fd56239-aa6b-44fd-b45f-dfa7af71b443 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1566 microversion: 2.1 time: 0.173238 Aug 18 15:02:48.315712 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 862/1124] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:48 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:02:49.326170 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-4b800739-fa2e-4192-984e-6527f022218e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:49.326937 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-4b800739-fa2e-4192-984e-6527f022218e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:49.333415 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4b800739-fa2e-4192-984e-6527f022218e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:49.333902 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4b800739-fa2e-4192-984e-6527f022218e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:49.334331 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4b800739-fa2e-4192-984e-6527f022218e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:49.335066 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4b800739-fa2e-4192-984e-6527f022218e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:49.335509 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4b800739-fa2e-4192-984e-6527f022218e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:49.336088 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-4b800739-fa2e-4192-984e-6527f022218e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:49.483208 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-4b800739-fa2e-4192-984e-6527f022218e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:49.492016 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-4b800739-fa2e-4192-984e-6527f022218e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1566 microversion: 2.1 time: 0.170503 Aug 18 15:02:49.492610 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 863/1125] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:49 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:02:50.520965 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d1e65175-72e0-4238-abf2-dd666bed336e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:50.522422 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d1e65175-72e0-4238-abf2-dd666bed336e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:50.530614 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d1e65175-72e0-4238-abf2-dd666bed336e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:50.531426 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d1e65175-72e0-4238-abf2-dd666bed336e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:50.531939 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d1e65175-72e0-4238-abf2-dd666bed336e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:50.532664 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d1e65175-72e0-4238-abf2-dd666bed336e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:50.533120 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d1e65175-72e0-4238-abf2-dd666bed336e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:50.533543 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d1e65175-72e0-4238-abf2-dd666bed336e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:50.737136 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-d1e65175-72e0-4238-abf2-dd666bed336e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:50.750360 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d1e65175-72e0-4238-abf2-dd666bed336e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1567 microversion: 2.1 time: 0.238820 Aug 18 15:02:50.764407 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 864/1126] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:50 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 15:02:50.773737 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-1caadd3e-cbe0-4d34-8686-cd05645128de tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:02:50.775727 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-1caadd3e-cbe0-4d34-8686-cd05645128de tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:50.782748 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1caadd3e-cbe0-4d34-8686-cd05645128de tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:50.783201 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1caadd3e-cbe0-4d34-8686-cd05645128de tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:50.783641 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1caadd3e-cbe0-4d34-8686-cd05645128de tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:50.784863 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1caadd3e-cbe0-4d34-8686-cd05645128de tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:50.785237 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1caadd3e-cbe0-4d34-8686-cd05645128de tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:50.786052 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-1caadd3e-cbe0-4d34-8686-cd05645128de tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:50.822939 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-1caadd3e-cbe0-4d34-8686-cd05645128de tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132268) unshelve /opt/stack/nova/nova/compute/api.py:4587}} Aug 18 15:02:50.915559 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-1caadd3e-cbe0-4d34-8686-cd05645128de tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "POST /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6/action" status: 202 len: 0 microversion: 2.1 time: 0.146256 Aug 18 15:02:50.916564 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 865/1127] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Aug 18 15:02:50 2022] POST /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 15:02:50.928859 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-3e435379-4f0e-44fb-bb00-af5da391df9f tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:50.929929 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-3e435379-4f0e-44fb-bb00-af5da391df9f tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:50.939540 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3e435379-4f0e-44fb-bb00-af5da391df9f tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:50.940089 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3e435379-4f0e-44fb-bb00-af5da391df9f tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:50.941084 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3e435379-4f0e-44fb-bb00-af5da391df9f tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:50.942320 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3e435379-4f0e-44fb-bb00-af5da391df9f tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:50.943092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3e435379-4f0e-44fb-bb00-af5da391df9f tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:50.943622 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-3e435379-4f0e-44fb-bb00-af5da391df9f tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:51.132851 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-3e435379-4f0e-44fb-bb00-af5da391df9f tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:51.142187 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-3e435379-4f0e-44fb-bb00-af5da391df9f tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1575 microversion: 2.1 time: 0.220104 Aug 18 15:02:51.143007 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 866/1128] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:50 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1575 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 15:02:52.167599 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e4533942-d01a-4a09-8978-f62021848e65 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:52.168855 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e4533942-d01a-4a09-8978-f62021848e65 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:52.177455 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e4533942-d01a-4a09-8978-f62021848e65 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:52.178139 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e4533942-d01a-4a09-8978-f62021848e65 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:52.178829 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e4533942-d01a-4a09-8978-f62021848e65 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:52.179962 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e4533942-d01a-4a09-8978-f62021848e65 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:52.186172 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e4533942-d01a-4a09-8978-f62021848e65 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:52.186821 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e4533942-d01a-4a09-8978-f62021848e65 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:52.425595 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e4533942-d01a-4a09-8978-f62021848e65 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:52.434978 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e4533942-d01a-4a09-8978-f62021848e65 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1515 microversion: 2.1 time: 0.274992 Aug 18 15:02:52.435994 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 867/1129] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:52 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1515 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:02:53.455703 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-265e85ff-1e92-491c-82cc-48f592bbc966 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:53.456633 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-265e85ff-1e92-491c-82cc-48f592bbc966 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:53.467771 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-265e85ff-1e92-491c-82cc-48f592bbc966 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:53.468304 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-265e85ff-1e92-491c-82cc-48f592bbc966 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:53.468704 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-265e85ff-1e92-491c-82cc-48f592bbc966 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:53.469417 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-265e85ff-1e92-491c-82cc-48f592bbc966 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:53.469858 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-265e85ff-1e92-491c-82cc-48f592bbc966 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:53.470483 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-265e85ff-1e92-491c-82cc-48f592bbc966 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:53.632307 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-265e85ff-1e92-491c-82cc-48f592bbc966 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:53.648894 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-265e85ff-1e92-491c-82cc-48f592bbc966 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1515 microversion: 2.1 time: 0.196759 Aug 18 15:02:53.650520 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 868/1130] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:53 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1515 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 15:02:54.682279 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-aebf6541-db7a-4302-9692-5a66535bfba0 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:54.684598 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-aebf6541-db7a-4302-9692-5a66535bfba0 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:54.697837 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aebf6541-db7a-4302-9692-5a66535bfba0 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:54.699701 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aebf6541-db7a-4302-9692-5a66535bfba0 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:54.700770 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aebf6541-db7a-4302-9692-5a66535bfba0 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:54.702299 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aebf6541-db7a-4302-9692-5a66535bfba0 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:54.703375 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aebf6541-db7a-4302-9692-5a66535bfba0 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:54.704775 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-aebf6541-db7a-4302-9692-5a66535bfba0 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:54.923876 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-aebf6541-db7a-4302-9692-5a66535bfba0 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:54.928010 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 15:02:54.933932 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-aebf6541-db7a-4302-9692-5a66535bfba0 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1515 microversion: 2.1 time: 0.260025 Aug 18 15:02:54.947481 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 869/1131] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:54 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1515 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 15:02:55.085845 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-4b1a974c-eef8-4a71-bea1-51ff615ba425 req-bf72716e-d8bd-4ca6-a7bf-9a83f8e4bf36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40cbcd5e-57d5-4177-8358-32279c6770d6", "name": "network-vif-unplugged", "status": "completed", "tag": "ba5c5ae4-144d-49b9-9e54-5dacaef83b8d"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:02:55.119269 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-4b1a974c-eef8-4a71-bea1-51ff615ba425 req-bf72716e-d8bd-4ca6-a7bf-9a83f8e4bf36 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:55.120164 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-4b1a974c-eef8-4a71-bea1-51ff615ba425 req-bf72716e-d8bd-4ca6-a7bf-9a83f8e4bf36 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:55.121077 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-4b1a974c-eef8-4a71-bea1-51ff615ba425 req-bf72716e-d8bd-4ca6-a7bf-9a83f8e4bf36 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:55.145136 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.compute.server_external_events [req-4b1a974c-eef8-4a71-bea1-51ff615ba425 req-bf72716e-d8bd-4ca6-a7bf-9a83f8e4bf36 service nova] Unable to find a host for instance 40cbcd5e-57d5-4177-8358-32279c6770d6. Dropping event network-vif-unplugged {{(pid=132268) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 18 15:02:55.146917 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-4b1a974c-eef8-4a71-bea1-51ff615ba425 req-bf72716e-d8bd-4ca6-a7bf-9a83f8e4bf36 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.201753 Aug 18 15:02:55.148071 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 870/1132] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 15:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 204 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 18 15:02:55.959196 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-16367e12-9c97-4292-9d05-525eebee1ba6 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:55.961115 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-16367e12-9c97-4292-9d05-525eebee1ba6 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:55.974983 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-16367e12-9c97-4292-9d05-525eebee1ba6 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:55.975830 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-16367e12-9c97-4292-9d05-525eebee1ba6 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:55.976387 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-16367e12-9c97-4292-9d05-525eebee1ba6 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:55.977745 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-16367e12-9c97-4292-9d05-525eebee1ba6 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:55.978934 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-16367e12-9c97-4292-9d05-525eebee1ba6 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:55.979565 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-16367e12-9c97-4292-9d05-525eebee1ba6 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:56.169731 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-16367e12-9c97-4292-9d05-525eebee1ba6 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:56.180049 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-16367e12-9c97-4292-9d05-525eebee1ba6 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1515 microversion: 2.1 time: 0.226950 Aug 18 15:02:56.182893 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 871/1133] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:55 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1515 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 15:02:57.206260 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-ba20d356-5c17-4810-9bfa-7a49d68950ce tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:57.207363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-ba20d356-5c17-4810-9bfa-7a49d68950ce tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:57.221768 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ba20d356-5c17-4810-9bfa-7a49d68950ce tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:57.222599 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ba20d356-5c17-4810-9bfa-7a49d68950ce tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:57.223349 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ba20d356-5c17-4810-9bfa-7a49d68950ce tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:57.224895 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ba20d356-5c17-4810-9bfa-7a49d68950ce tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:57.225696 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ba20d356-5c17-4810-9bfa-7a49d68950ce tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:57.226434 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-ba20d356-5c17-4810-9bfa-7a49d68950ce tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:57.389509 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-ba20d356-5c17-4810-9bfa-7a49d68950ce tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:57.399162 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-ba20d356-5c17-4810-9bfa-7a49d68950ce tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1517 microversion: 2.1 time: 0.198894 Aug 18 15:02:57.399510 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 872/1134] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:57 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1517 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:02:58.422751 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-e67aee0b-9e17-49fd-9d71-f5de385b6dac tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:58.423454 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-e67aee0b-9e17-49fd-9d71-f5de385b6dac tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:58.430169 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e67aee0b-9e17-49fd-9d71-f5de385b6dac tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:58.430641 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e67aee0b-9e17-49fd-9d71-f5de385b6dac tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:58.431158 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e67aee0b-9e17-49fd-9d71-f5de385b6dac tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:58.431887 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e67aee0b-9e17-49fd-9d71-f5de385b6dac tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:58.432333 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e67aee0b-9e17-49fd-9d71-f5de385b6dac tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:58.432750 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-e67aee0b-9e17-49fd-9d71-f5de385b6dac tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:58.586540 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-e67aee0b-9e17-49fd-9d71-f5de385b6dac tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:58.594973 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-e67aee0b-9e17-49fd-9d71-f5de385b6dac tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1573 microversion: 2.1 time: 0.176269 Aug 18 15:02:58.595548 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 873/1135] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:58 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1573 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:02:59.615093 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2818d2f0-01cf-437d-91b9-2d4869dedfc5 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:02:59.615836 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2818d2f0-01cf-437d-91b9-2d4869dedfc5 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:02:59.622192 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2818d2f0-01cf-437d-91b9-2d4869dedfc5 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:59.622677 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2818d2f0-01cf-437d-91b9-2d4869dedfc5 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:59.623107 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2818d2f0-01cf-437d-91b9-2d4869dedfc5 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:59.623824 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2818d2f0-01cf-437d-91b9-2d4869dedfc5 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:02:59.624268 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2818d2f0-01cf-437d-91b9-2d4869dedfc5 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:02:59.624684 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2818d2f0-01cf-437d-91b9-2d4869dedfc5 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:02:59.768333 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2818d2f0-01cf-437d-91b9-2d4869dedfc5 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:02:59.777092 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2818d2f0-01cf-437d-91b9-2d4869dedfc5 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1573 microversion: 2.1 time: 0.165969 Aug 18 15:02:59.777739 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 874/1136] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:02:59 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:03:00.797789 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-6197fec8-6c94-4a94-a81e-4f4e60340907 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:03:00.798515 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-6197fec8-6c94-4a94-a81e-4f4e60340907 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:03:00.804959 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6197fec8-6c94-4a94-a81e-4f4e60340907 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:03:00.805439 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6197fec8-6c94-4a94-a81e-4f4e60340907 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:03:00.805867 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6197fec8-6c94-4a94-a81e-4f4e60340907 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:03:00.807140 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6197fec8-6c94-4a94-a81e-4f4e60340907 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:03:00.807588 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6197fec8-6c94-4a94-a81e-4f4e60340907 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:03:00.808032 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-6197fec8-6c94-4a94-a81e-4f4e60340907 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:03:00.944551 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-6197fec8-6c94-4a94-a81e-4f4e60340907 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:03:00.952458 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-6197fec8-6c94-4a94-a81e-4f4e60340907 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1573 microversion: 2.1 time: 0.158676 Aug 18 15:03:00.953028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 875/1137] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:03:00 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:03:01.973879 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c77359fb-3abd-49fd-896a-edcfd60d3543 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:03:01.974557 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c77359fb-3abd-49fd-896a-edcfd60d3543 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:03:01.981568 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c77359fb-3abd-49fd-896a-edcfd60d3543 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:03:01.982053 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c77359fb-3abd-49fd-896a-edcfd60d3543 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:03:01.982488 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c77359fb-3abd-49fd-896a-edcfd60d3543 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:03:01.983179 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c77359fb-3abd-49fd-896a-edcfd60d3543 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:03:01.983629 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c77359fb-3abd-49fd-896a-edcfd60d3543 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:03:01.984082 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c77359fb-3abd-49fd-896a-edcfd60d3543 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:03:02.117074 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c77359fb-3abd-49fd-896a-edcfd60d3543 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:03:02.125680 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c77359fb-3abd-49fd-896a-edcfd60d3543 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1573 microversion: 2.1 time: 0.155687 Aug 18 15:03:02.126253 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 876/1138] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:03:01 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:03:03.146816 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-b56a6eeb-1425-4b40-87dc-8c4312074b30 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:03:03.147606 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-b56a6eeb-1425-4b40-87dc-8c4312074b30 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:03:03.153966 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b56a6eeb-1425-4b40-87dc-8c4312074b30 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:03:03.154385 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b56a6eeb-1425-4b40-87dc-8c4312074b30 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:03:03.154817 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b56a6eeb-1425-4b40-87dc-8c4312074b30 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:03:03.155512 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b56a6eeb-1425-4b40-87dc-8c4312074b30 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:03:03.156006 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b56a6eeb-1425-4b40-87dc-8c4312074b30 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:03:03.156429 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-b56a6eeb-1425-4b40-87dc-8c4312074b30 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:03:03.291592 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-b56a6eeb-1425-4b40-87dc-8c4312074b30 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:03:03.299509 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-b56a6eeb-1425-4b40-87dc-8c4312074b30 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1573 microversion: 2.1 time: 0.156620 Aug 18 15:03:03.300105 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 877/1139] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:03:03 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:03:04.320926 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-9002e424-33bc-40af-ac4c-5922229935d5 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:03:04.321675 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-9002e424-33bc-40af-ac4c-5922229935d5 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:03:04.328595 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9002e424-33bc-40af-ac4c-5922229935d5 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:03:04.329500 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9002e424-33bc-40af-ac4c-5922229935d5 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:03:04.329940 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9002e424-33bc-40af-ac4c-5922229935d5 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:03:04.330639 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9002e424-33bc-40af-ac4c-5922229935d5 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:03:04.331096 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9002e424-33bc-40af-ac4c-5922229935d5 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:03:04.331514 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-9002e424-33bc-40af-ac4c-5922229935d5 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:03:04.470775 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-9002e424-33bc-40af-ac4c-5922229935d5 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:03:04.479186 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-9002e424-33bc-40af-ac4c-5922229935d5 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1573 microversion: 2.1 time: 0.162175 Aug 18 15:03:04.479780 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 878/1140] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:03:04 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:03:05.500477 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-c7b94422-c947-4cda-99ec-3ac55d00b56e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:03:05.501214 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-c7b94422-c947-4cda-99ec-3ac55d00b56e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:03:05.507774 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c7b94422-c947-4cda-99ec-3ac55d00b56e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:03:05.508289 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c7b94422-c947-4cda-99ec-3ac55d00b56e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:03:05.508763 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c7b94422-c947-4cda-99ec-3ac55d00b56e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:03:05.510132 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c7b94422-c947-4cda-99ec-3ac55d00b56e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:03:05.510578 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c7b94422-c947-4cda-99ec-3ac55d00b56e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:03:05.511050 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-c7b94422-c947-4cda-99ec-3ac55d00b56e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:03:05.647044 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-c7b94422-c947-4cda-99ec-3ac55d00b56e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:03:05.655087 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-c7b94422-c947-4cda-99ec-3ac55d00b56e tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1573 microversion: 2.1 time: 0.158498 Aug 18 15:03:05.655658 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 879/1141] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:03:05 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:03:06.676123 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-5b0bf328-2c5f-4832-a4b4-ec28a35f4342 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:03:06.676795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-5b0bf328-2c5f-4832-a4b4-ec28a35f4342 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:03:06.683545 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5b0bf328-2c5f-4832-a4b4-ec28a35f4342 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:03:06.684058 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5b0bf328-2c5f-4832-a4b4-ec28a35f4342 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:03:06.684493 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5b0bf328-2c5f-4832-a4b4-ec28a35f4342 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:03:06.685185 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5b0bf328-2c5f-4832-a4b4-ec28a35f4342 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:03:06.685635 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5b0bf328-2c5f-4832-a4b4-ec28a35f4342 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:03:06.686059 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-5b0bf328-2c5f-4832-a4b4-ec28a35f4342 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:03:06.819937 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-5b0bf328-2c5f-4832-a4b4-ec28a35f4342 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:03:06.828250 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-5b0bf328-2c5f-4832-a4b4-ec28a35f4342 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1573 microversion: 2.1 time: 0.156040 Aug 18 15:03:06.828817 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 880/1142] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:03:06 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:03:07.850129 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-dea8b515-3fc3-4e6d-bdb3-afa81a9a737c tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:03:07.850800 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-dea8b515-3fc3-4e6d-bdb3-afa81a9a737c tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:03:07.853900 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 15:03:07.859795 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dea8b515-3fc3-4e6d-bdb3-afa81a9a737c tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:03:07.860285 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dea8b515-3fc3-4e6d-bdb3-afa81a9a737c tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:03:07.860720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dea8b515-3fc3-4e6d-bdb3-afa81a9a737c tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:03:07.861423 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dea8b515-3fc3-4e6d-bdb3-afa81a9a737c tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:03:07.861882 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dea8b515-3fc3-4e6d-bdb3-afa81a9a737c tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:03:07.862306 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-dea8b515-3fc3-4e6d-bdb3-afa81a9a737c tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:03:07.999960 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-dea8b515-3fc3-4e6d-bdb3-afa81a9a737c tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:03:08.007885 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-dea8b515-3fc3-4e6d-bdb3-afa81a9a737c tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1573 microversion: 2.1 time: 0.161875 Aug 18 15:03:08.008440 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 881/1143] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:03:07 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:03:08.559341 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-5eacffdb-efc9-413c-acdb-5340dd63353d req-e5cad457-9df8-4d27-afc1-4204f7a9b7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40cbcd5e-57d5-4177-8358-32279c6770d6", "name": "network-vif-plugged", "status": "completed", "tag": "ba5c5ae4-144d-49b9-9e54-5dacaef83b8d"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:03:08.574576 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-5eacffdb-efc9-413c-acdb-5340dd63353d req-e5cad457-9df8-4d27-afc1-4204f7a9b7d2 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:03:08.575081 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-5eacffdb-efc9-413c-acdb-5340dd63353d req-e5cad457-9df8-4d27-afc1-4204f7a9b7d2 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:03:08.575479 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-5eacffdb-efc9-413c-acdb-5340dd63353d req-e5cad457-9df8-4d27-afc1-4204f7a9b7d2 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:03:08.587227 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-5eacffdb-efc9-413c-acdb-5340dd63353d req-e5cad457-9df8-4d27-afc1-4204f7a9b7d2 service nova] Creating event network-vif-plugged:ba5c5ae4-144d-49b9-9e54-5dacaef83b8d for instance 40cbcd5e-57d5-4177-8358-32279c6770d6 on hv-cinder-85220 Aug 18 15:03:08.602749 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-5eacffdb-efc9-413c-acdb-5340dd63353d req-e5cad457-9df8-4d27-afc1-4204f7a9b7d2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049576 Aug 18 15:03:08.603350 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 882/1144] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 15:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 15:03:09.030102 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-82f667d3-dec3-44b9-978d-4a21ce4fe864 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:03:09.030800 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-82f667d3-dec3-44b9-978d-4a21ce4fe864 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:03:09.037018 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-82f667d3-dec3-44b9-978d-4a21ce4fe864 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:03:09.037489 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-82f667d3-dec3-44b9-978d-4a21ce4fe864 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:03:09.037912 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-82f667d3-dec3-44b9-978d-4a21ce4fe864 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:03:09.038598 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-82f667d3-dec3-44b9-978d-4a21ce4fe864 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:03:09.039045 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-82f667d3-dec3-44b9-978d-4a21ce4fe864 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:03:09.039462 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-82f667d3-dec3-44b9-978d-4a21ce4fe864 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:03:09.173527 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-82f667d3-dec3-44b9-978d-4a21ce4fe864 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:03:09.181332 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-82f667d3-dec3-44b9-978d-4a21ce4fe864 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1573 microversion: 2.1 time: 0.155892 Aug 18 15:03:09.181919 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 883/1145] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:03:09 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 15:03:10.202399 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-2d31bd26-0a45-4abe-abdc-5b37cec44ca8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:03:10.203088 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-2d31bd26-0a45-4abe-abdc-5b37cec44ca8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:03:10.209434 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2d31bd26-0a45-4abe-abdc-5b37cec44ca8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:03:10.209923 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2d31bd26-0a45-4abe-abdc-5b37cec44ca8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:03:10.210357 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2d31bd26-0a45-4abe-abdc-5b37cec44ca8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:03:10.211047 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2d31bd26-0a45-4abe-abdc-5b37cec44ca8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:03:10.211498 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2d31bd26-0a45-4abe-abdc-5b37cec44ca8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:03:10.212475 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-2d31bd26-0a45-4abe-abdc-5b37cec44ca8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:03:10.345977 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-2d31bd26-0a45-4abe-abdc-5b37cec44ca8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:03:10.353826 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-2d31bd26-0a45-4abe-abdc-5b37cec44ca8 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1573 microversion: 2.1 time: 0.155306 Aug 18 15:03:10.354430 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 884/1146] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:03:10 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:03:11.374941 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-23100873-2daf-48b7-9f95-9a17a5c54a07 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:03:11.375596 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-23100873-2daf-48b7-9f95-9a17a5c54a07 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:03:11.382264 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-23100873-2daf-48b7-9f95-9a17a5c54a07 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:03:11.382749 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-23100873-2daf-48b7-9f95-9a17a5c54a07 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:03:11.383183 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-23100873-2daf-48b7-9f95-9a17a5c54a07 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:03:11.383948 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-23100873-2daf-48b7-9f95-9a17a5c54a07 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:03:11.384390 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-23100873-2daf-48b7-9f95-9a17a5c54a07 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:03:11.384812 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-23100873-2daf-48b7-9f95-9a17a5c54a07 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:03:11.519963 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-23100873-2daf-48b7-9f95-9a17a5c54a07 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:03:11.528401 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-23100873-2daf-48b7-9f95-9a17a5c54a07 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1560 microversion: 2.1 time: 0.157363 Aug 18 15:03:11.528971 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 885/1147] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:03:11 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 15:04:28.020982 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-d95e625e-135e-4043-87cd-cf3d295a3460 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:04:28.021620 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d95e625e-135e-4043-87cd-cf3d295a3460 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:04:28.023708 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_api:SELECT=9 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 15:04:28.024357 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG dbcounter [-] [132268] Writing DB stats nova_cell1:SELECT=88 {{(pid=132268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 15:04:28.030196 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d95e625e-135e-4043-87cd-cf3d295a3460 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:04:28.030711 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d95e625e-135e-4043-87cd-cf3d295a3460 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:04:28.031144 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d95e625e-135e-4043-87cd-cf3d295a3460 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:04:28.031874 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d95e625e-135e-4043-87cd-cf3d295a3460 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:04:28.032325 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d95e625e-135e-4043-87cd-cf3d295a3460 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:04:28.033247 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-d95e625e-135e-4043-87cd-cf3d295a3460 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:04:28.058602 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-d95e625e-135e-4043-87cd-cf3d295a3460 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Going to try to terminate instance {{(pid=132268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 15:04:28.145259 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-d95e625e-135e-4043-87cd-cf3d295a3460 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "DELETE /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 204 len: 0 microversion: 2.1 time: 0.128840 Aug 18 15:04:28.145778 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 886/1148] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Aug 18 15:04:28 2022] DELETE /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 15:04:28.152420 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-97779ea8-7049-43b8-ace5-845293e45ba4 req-f75a0e2c-aa2c-4a9e-8fce-de4134907f18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40cbcd5e-57d5-4177-8358-32279c6770d6", "tag": "ba5c5ae4-144d-49b9-9e54-5dacaef83b8d"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:04:28.163083 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-97779ea8-7049-43b8-ace5-845293e45ba4 req-f75a0e2c-aa2c-4a9e-8fce-de4134907f18 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:04:28.163563 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-97779ea8-7049-43b8-ace5-845293e45ba4 req-f75a0e2c-aa2c-4a9e-8fce-de4134907f18 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:04:28.164020 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-97779ea8-7049-43b8-ace5-845293e45ba4 req-f75a0e2c-aa2c-4a9e-8fce-de4134907f18 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:04:28.177901 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-97779ea8-7049-43b8-ace5-845293e45ba4 req-f75a0e2c-aa2c-4a9e-8fce-de4134907f18 service nova] Creating event network-changed:ba5c5ae4-144d-49b9-9e54-5dacaef83b8d for instance 40cbcd5e-57d5-4177-8358-32279c6770d6 on hv-cinder-85220 Aug 18 15:04:28.183574 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-97779ea8-7049-43b8-ace5-845293e45ba4 req-f75a0e2c-aa2c-4a9e-8fce-de4134907f18 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036165 Aug 18 15:04:28.184817 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 887/1149] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 15:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 15:04:28.191925 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-0f46744c-03ac-437e-bf80-abe930204b53 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:04:28.193940 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-0f46744c-03ac-437e-bf80-abe930204b53 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:04:28.208621 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0f46744c-03ac-437e-bf80-abe930204b53 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:04:28.208621 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0f46744c-03ac-437e-bf80-abe930204b53 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:04:28.209119 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0f46744c-03ac-437e-bf80-abe930204b53 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:04:28.210216 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0f46744c-03ac-437e-bf80-abe930204b53 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:04:28.210758 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0f46744c-03ac-437e-bf80-abe930204b53 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:04:28.211246 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-0f46744c-03ac-437e-bf80-abe930204b53 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:04:28.364833 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-0f46744c-03ac-437e-bf80-abe930204b53 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:04:28.373220 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-0f46744c-03ac-437e-bf80-abe930204b53 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1566 microversion: 2.1 time: 0.186728 Aug 18 15:04:28.373801 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 888/1150] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:04:28 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1566 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 15:04:29.395426 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-273e537b-7934-4237-8876-990ba43a2386 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:04:29.396149 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-273e537b-7934-4237-8876-990ba43a2386 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:04:29.403624 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-273e537b-7934-4237-8876-990ba43a2386 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:04:29.404216 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-273e537b-7934-4237-8876-990ba43a2386 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:04:29.404681 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-273e537b-7934-4237-8876-990ba43a2386 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:04:29.405455 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-273e537b-7934-4237-8876-990ba43a2386 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:04:29.405965 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-273e537b-7934-4237-8876-990ba43a2386 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:04:29.406429 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-273e537b-7934-4237-8876-990ba43a2386 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:04:29.597900 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-273e537b-7934-4237-8876-990ba43a2386 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:04:29.606202 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-273e537b-7934-4237-8876-990ba43a2386 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1566 microversion: 2.1 time: 0.214734 Aug 18 15:04:29.606784 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 889/1151] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:04:29 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1566 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 15:04:30.628168 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-122f1f99-dd9c-420d-861e-dc5a38e39bcd tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:04:30.629508 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-122f1f99-dd9c-420d-861e-dc5a38e39bcd tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:04:30.636677 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-122f1f99-dd9c-420d-861e-dc5a38e39bcd tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:04:30.637276 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-122f1f99-dd9c-420d-861e-dc5a38e39bcd tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:04:30.637720 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-122f1f99-dd9c-420d-861e-dc5a38e39bcd tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:04:30.638493 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-122f1f99-dd9c-420d-861e-dc5a38e39bcd tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:04:30.638943 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-122f1f99-dd9c-420d-861e-dc5a38e39bcd tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:04:30.639363 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-122f1f99-dd9c-420d-861e-dc5a38e39bcd tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:04:30.704458 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.policy [None req-122f1f99-dd9c-420d-861e-dc5a38e39bcd tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3a4f725f3d41edbb7c162a8760bf8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379b08d3cf834ca9b891abd6ba0f14ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 15:04:30.713614 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-122f1f99-dd9c-420d-861e-dc5a38e39bcd tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 200 len: 1381 microversion: 2.1 time: 0.089536 Aug 18 15:04:30.714187 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 890/1152] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:04:30 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 1381 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 15:04:30.721840 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [req-f6680588-1b00-47dc-88c5-52f01e5b2d82 req-0d057fff-6faf-4d61-8a1d-bc8775fd2344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40cbcd5e-57d5-4177-8358-32279c6770d6", "name": "network-vif-deleted", "tag": "ba5c5ae4-144d-49b9-9e54-5dacaef83b8d"}]} {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 15:04:30.732221 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-f6680588-1b00-47dc-88c5-52f01e5b2d82 req-0d057fff-6faf-4d61-8a1d-bc8775fd2344 service nova] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:04:30.732699 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-f6680588-1b00-47dc-88c5-52f01e5b2d82 req-0d057fff-6faf-4d61-8a1d-bc8775fd2344 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:04:30.733132 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [req-f6680588-1b00-47dc-88c5-52f01e5b2d82 req-0d057fff-6faf-4d61-8a1d-bc8775fd2344 service nova] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:04:30.744480 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.compute.server_external_events [req-f6680588-1b00-47dc-88c5-52f01e5b2d82 req-0d057fff-6faf-4d61-8a1d-bc8775fd2344 service nova] Creating event network-vif-deleted:ba5c5ae4-144d-49b9-9e54-5dacaef83b8d for instance 40cbcd5e-57d5-4177-8358-32279c6770d6 on hv-cinder-85220 Aug 18 15:04:30.749273 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [req-f6680588-1b00-47dc-88c5-52f01e5b2d82 req-0d057fff-6faf-4d61-8a1d-bc8775fd2344 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033994 Aug 18 15:04:30.749847 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 891/1153] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Aug 18 15:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 15:04:31.736835 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-59fb9cf3-73f8-4e89-b280-5d4faa8e72b1 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:04:31.737524 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.compute.api [None req-59fb9cf3-73f8-4e89-b280-5d4faa8e72b1 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] [instance: 40cbcd5e-57d5-4177-8358-32279c6770d6] Fetching instance by UUID {{(pid=132268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 15:04:31.743641 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-59fb9cf3-73f8-4e89-b280-5d4faa8e72b1 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:04:31.744219 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-59fb9cf3-73f8-4e89-b280-5d4faa8e72b1 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:04:31.744625 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-59fb9cf3-73f8-4e89-b280-5d4faa8e72b1 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:04:31.745322 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-59fb9cf3-73f8-4e89-b280-5d4faa8e72b1 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Acquiring lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 15:04:31.745782 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-59fb9cf3-73f8-4e89-b280-5d4faa8e72b1 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 15:04:31.746209 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG oslo_concurrency.lockutils [None req-59fb9cf3-73f8-4e89-b280-5d4faa8e72b1 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Lock "b3f44a74-f470-4dbc-81de-0c86ad3f4d2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 15:04:31.759396 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.wsgi [None req-59fb9cf3-73f8-4e89-b280-5d4faa8e72b1 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] HTTP exception thrown: Instance 40cbcd5e-57d5-4177-8358-32279c6770d6 could not be found. Aug 18 15:04:31.761028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-59fb9cf3-73f8-4e89-b280-5d4faa8e72b1 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Request method failure captured: Aug 18 15:04:31.761028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: request: GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 HTTP/1.1 Aug 18 15:04:31.761028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept: application/json Aug 18 15:04:31.761028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Accept-Encoding: identity Aug 18 15:04:31.761028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Connection: close Aug 18 15:04:31.761028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Length: 0 Aug 18 15:04:31.761028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Content-Type: application/json Aug 18 15:04:31.761028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Host: 10.222.0.36 Aug 18 15:04:31.761028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Openstack-System-Scope: None Aug 18 15:04:31.761028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: User-Agent: python-urllib3/1.26.11 Aug 18 15:04:31.761028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Auth-Token: gAAAAABi_lPnjCg0kLJ-07liEADYhF1vDKTuaAzgsNZE_3JiXeqn4Jx3wkO26OqunhULQs7amxuaCA3T-rxrIjm3iYyfjAQ6gstEWj3gMne_TuV4DvUpuX3Ms2EKfNTgeSWFitxFI3wwD7gKAL6CSQoMUdCb4v2p9snvMyuynDYyWUgBPLeipps Aug 18 15:04:31.761028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Id: None Aug 18 15:04:31.761028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Domain-Name: None Aug 18 15:04:31.761028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Identity-Status: Confirmed Aug 18 15:04:31.761028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Is-Admin-Project: True Aug 18 15:04:31.761028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Id: default Aug 18 15:04:31.761028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Domain-Name: Default Aug 18 15:04:31.761028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Id: 379b08d3cf834ca9b891abd6ba0f14ee Aug 18 15:04:31.761028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Project-Name: tempest-TestShelveInstance-949058315 Aug 18 15:04:31.761028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Role: reader,member Aug 18 15:04:31.761028 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Roles: reader,member Aug 18 15:04:31.762850 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/379b08d3cf834ca9b891abd6ba0f14ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/379b08d3cf834ca9b891abd6ba0f14ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_379b08d3cf834ca9b891abd6ba0f14ee", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/379b08d3cf834ca9b891abd6ba0f14ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}] Aug 18 15:04:31.762850 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant: tempest-TestShelveInstance-949058315 Aug 18 15:04:31.762850 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Id: 379b08d3cf834ca9b891abd6ba0f14ee Aug 18 15:04:31.762850 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-Tenant-Name: tempest-TestShelveInstance-949058315 Aug 18 15:04:31.762850 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User: tempest-TestShelveInstance-949058315-project Aug 18 15:04:31.762850 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Id: default Aug 18 15:04:31.762850 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Domain-Name: Default Aug 18 15:04:31.762850 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Id: 1e3a4f725f3d41edbb7c162a8760bf8b Aug 18 15:04:31.762850 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: X-User-Name: tempest-TestShelveInstance-949058315-project Aug 18 15:04:31.762850 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: method: > Aug 18 15:04:31.762850 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: exception: Instance 40cbcd5e-57d5-4177-8358-32279c6770d6 could not be found. Aug 18 15:04:31.762850 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: action_args: {'id': '40cbcd5e-57d5-4177-8358-32279c6770d6'} Aug 18 15:04:31.764015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 15:04:31.764015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 15:04:31.764015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 15:04:31.764015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 15:04:31.764015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 15:04:31.764015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 15:04:31.764015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 15:04:31.764015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 15:04:31.764015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 15:04:31.764015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 15:04:31.764015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40cbcd5e-57d5-4177-8358-32279c6770d6 could not be found. Aug 18 15:04:31.764015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:04:31.764015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 15:04:31.764015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:04:31.764015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 15:04:31.764015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 15:04:31.764015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 15:04:31.764015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 15:04:31.764015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 15:04:31.764015 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 15:04:31.765976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 15:04:31.765976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 15:04:31.765976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 15:04:31.765976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 15:04:31.765976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 15:04:31.765976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 15:04:31.765976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 15:04:31.765976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40cbcd5e-57d5-4177-8358-32279c6770d6 could not be found. Aug 18 15:04:31.765976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:04:31.765976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 15:04:31.765976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:04:31.765976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 15:04:31.765976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 15:04:31.765976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 15:04:31.765976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 15:04:31.765976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 15:04:31.765976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40cbcd5e-57d5-4177-8358-32279c6770d6 could not be found. Aug 18 15:04:31.765976 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: ERROR nova.api.openstack.wsgi Aug 18 15:04:31.767468 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-59fb9cf3-73f8-4e89-b280-5d4faa8e72b1 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Returning 404 to user: Instance 40cbcd5e-57d5-4177-8358-32279c6770d6 could not be found. {{(pid=132268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 15:04:31.767468 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-59fb9cf3-73f8-4e89-b280-5d4faa8e72b1 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6" status: 404 len: 111 microversion: 2.1 time: 0.031031 Aug 18 15:04:31.767468 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 892/1154] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Aug 18 15:04:31 2022] GET /compute/v2.1/servers/40cbcd5e-57d5-4177-8358-32279c6770d6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 15:04:31.920194 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: DEBUG nova.api.openstack.wsgi [None req-868c0e65-4c99-4cf4-bef9-acc414bdd574 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] Calling method '.version_select at 0x7fb20efcf4c0>' {{(pid=132268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 15:04:31.941013 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO nova.api.openstack.requestlog [None req-868c0e65-4c99-4cf4-bef9-acc414bdd574 tempest-TestShelveInstance-949058315 tempest-TestShelveInstance-949058315-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-797180520" status: 202 len: 0 microversion: 2.1 time: 0.024760 Aug 18 15:04:31.941750 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: [pid: 132268|app: 0|req: 893/1155] 10.222.0.36 () {58 vars in 1251 bytes} [Thu Aug 18 15:04:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-797180520 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 15:06:38.101078 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 15:06:38.101826 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Thu Aug 18 15:06:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 15:06:48.276530 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 15:06:48.277385 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Thu Aug 18 15:06:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 15:08:11.407378 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 15:08:11.408130 dv-cinder-852208-7-iscsi devstack@n-api.service[132268]: Thu Aug 18 15:08:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!